-- Logs begin at Tue 2022-05-17 21:03:56 UTC, end at Tue 2022-05-17 22:31:17 UTC. -- May 17 21:59:35.519876 dv-cinder-839987-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 21:59:35.528603 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 21:59:35.530530 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 21:59:35 2022] *** May 17 21:59:35.530530 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 21:59:35.530530 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 21:59:35.530530 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: nodename: dv-cinder-839987-6-iscsi May 17 21:59:35.530530 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: machine: x86_64 May 17 21:59:35.530530 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: clock source: unix May 17 21:59:35.530530 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: pcre jit disabled May 17 21:59:35.530530 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: detected number of CPU cores: 4 May 17 21:59:35.530530 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: current working directory: / May 17 21:59:35.530530 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: detected binary path: /usr/bin/uwsgi-core May 17 21:59:35.531324 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: your processes number limit is 47680 May 17 21:59:35.531324 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: your memory page size is 4096 bytes May 17 21:59:35.531324 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: detected max file descriptor number: 2048 May 17 21:59:35.531324 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: lock engine: pthread robust mutexes May 17 21:59:35.531324 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: thunder lock: enabled May 17 21:59:35.531324 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 21:59:35.531324 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 21:59:35.577386 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: Python main interpreter initialized at 0x55b0570c29c0 May 17 21:59:35.577386 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: python threads support enabled May 17 21:59:35.577386 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: your server socket listen backlog is limited to 100 connections May 17 21:59:35.577386 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: your mercy for graceful operations on workers is 90 seconds May 17 21:59:35.577727 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: mapped 403077 bytes (393 KB) for 2 cores May 17 21:59:35.577816 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: *** Operational MODE: preforking *** May 17 21:59:35.578040 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: *** uWSGI is running in multiple interpreter mode *** May 17 21:59:35.578040 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: spawned uWSGI master process (pid: 103204) May 17 21:59:35.578218 dv-cinder-839987-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 21:59:35.579696 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: spawned uWSGI worker 1 (pid: 103205, cores: 1) May 17 21:59:35.579696 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: spawned uWSGI worker 2 (pid: 103206, cores: 1) May 17 21:59:35.579696 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 21:59:36.788408 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 21:59:36.792310 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 21:59:37.523001 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 21:59:37.523001 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: from cryptography.utils import int_from_bytes May 17 21:59:37.523351 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 21:59:37.523351 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: from cryptography.utils import int_from_bytes May 17 21:59:37.527948 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 21:59:37.527948 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: from cryptography.utils import int_from_bytes May 17 21:59:37.528276 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 21:59:37.528276 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: from cryptography.utils import int_from_bytes May 17 21:59:40.171636 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 21:59:40.172166 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 21:59:40.172281 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 21:59:40.172281 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 21:59:40.172700 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 21:59:40.172700 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 21:59:40.172844 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 21:59:40.172932 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 21:59:40.173022 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 21:59:40.173278 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 21:59:40.173381 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.173600 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.173697 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.173923 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.174022 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.174241 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.174329 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.174563 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.174662 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.174871 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.174954 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.175215 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.175305 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.175533 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.175631 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.176414 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.176552 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.176748 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.176852 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.177006 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.177208 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.177359 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.177535 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839987-6-iscsi {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.177681 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839987-6-iscsi {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.177861 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.177997 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.178178 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.178300 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.178491 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.178605 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.178810 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.178910 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.179128 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.179215 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.179461 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.179556 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.179775 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.179893 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.180518 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.180633 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.180953 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.181051 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.181256 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.181347 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.181561 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.181648 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.181892 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.181988 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.182201 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.182287 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.182504 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.182698 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.182878 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.183116 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.183309 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.183495 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.183670 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.183846 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.184024 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.184217 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.184433 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839987-6-iscsi {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.184619 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839987-6-iscsi {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.184793 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.184966 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.185140 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.185315 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.185315 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.185644 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.185858 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.186062 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.186252 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.186418 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.186617 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.186751 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.186903 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.187035 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.187196 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.187363 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.187493 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.187623 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.187747 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.187869 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.188025 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.188162 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.188297 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.188428 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.188557 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.188693 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.188826 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.188982 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.189137 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.189247 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.189397 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.189524 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.189660 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.189791 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.189933 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.190063 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.190187 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.190318 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.190454 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.190583 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.190714 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.190843 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.190966 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.191096 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.191237 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.191370 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.191570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.192306 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.192439 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.192565 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.192690 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.192821 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.192946 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.193069 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.193271 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.193397 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.193522 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.193653 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.193777 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.193907 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.194030 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.194152 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.194275 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.194396 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.194519 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.194650 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.194780 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.194903 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.195096 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.195260 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.195420 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.195558 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.195758 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.195884 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.196070 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.196198 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.196490 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.196655 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.196766 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.196871 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.197042 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.197157 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.197440 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.197554 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.197689 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.197809 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.197993 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.198106 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.198327 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.198448 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.198640 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.198752 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.198946 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.199057 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.200078 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.200213 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.200337 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.200460 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.200584 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.200706 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.200706 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.200950 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.201076 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.201205 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.201329 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.201464 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.201595 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.201726 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.201851 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.201974 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.202102 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.202238 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.202362 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.202484 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.202605 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.202734 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.202867 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.203000 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.203174 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.203300 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.203435 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.203560 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.203683 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.203817 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.203941 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.204080 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.204217 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.204355 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.204536 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.204672 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.204672 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.204905 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.205034 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.205158 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.205292 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.205422 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.205553 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.205686 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.205833 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.205955 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.206088 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.206211 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.206342 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.206466 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.206588 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.206711 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.206888 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.207026 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.208165 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.208309 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.208437 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.208568 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.208707 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.208833 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.208970 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.209108 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.209234 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.209357 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.209357 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.209599 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.209722 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.209852 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.209976 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.210099 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.210230 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.210365 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.210500 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.210625 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.210756 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.210886 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.211018 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.211161 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.211297 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.211423 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.211545 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.211685 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.211810 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.211943 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.211943 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.212183 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.212305 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.212441 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.212572 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.212696 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.212818 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.212940 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.213062 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.213192 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.213192 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.213440 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.213564 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.213693 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.213816 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.213947 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.214084 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.214208 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.214330 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.214491 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.214617 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.214748 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.214879 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.215009 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.215208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.215341 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.215476 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.215602 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.215784 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.215920 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.216084 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.216212 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.216403 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.216531 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 21:59:40.216731 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.216865 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.217058 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.217186 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.217395 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.217596 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.217721 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.217826 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.218030 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.218178 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.218361 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.218490 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.218680 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.218808 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.218994 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.219242 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.219372 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.219500 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.219623 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.219747 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.219926 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.220066 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.220232 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.220359 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.220538 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.220664 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.220852 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.220987 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.221164 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.221313 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.221488 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.221616 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.221801 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.221937 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.222113 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.222240 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.222428 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.222554 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.222792 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.223010 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.223171 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.223418 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.223552 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.223677 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.223819 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.223946 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.224069 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.224181 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.224377 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.224491 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.224718 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.224833 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.225032 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.225144 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.225355 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.225468 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.225677 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.225807 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.225989 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.226103 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.226299 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.226412 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.226607 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.226719 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.226925 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.227038 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.227274 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.228727 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.228842 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.228940 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229025 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229103 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229180 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229265 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229343 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229420 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229420 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229574 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229653 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229743 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229828 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229905 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.229981 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.230064 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.230141 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.230229 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.230308 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.230384 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.230602 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.230697 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.230921 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.231024 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.231256 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.231345 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.231569 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.231697 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.231874 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.232001 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.232176 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.232313 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.232477 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.232611 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.232777 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.232913 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.233083 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.233218 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.233413 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.233552 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.233692 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.233824 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.233990 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.234118 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.234296 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.234452 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.234621 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.234748 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.234928 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.235063 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.235257 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.235397 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.235564 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.235692 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.235869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.235997 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.236170 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.236310 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.236481 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.236618 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.236785 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.236913 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.237086 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.237220 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.237402 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.237537 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.237708 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.237833 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.238008 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.238141 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.238855 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.239001 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.239469 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.239605 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.239605 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.239852 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.239975 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.240099 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.240229 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.240354 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.240486 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.240642 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.240794 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.240958 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.241085 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.241271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.241408 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.241596 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.241732 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.241911 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.242037 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.242225 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.242433 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.242568 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.242699 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.242874 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.243001 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.243207 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.243339 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.243532 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.243671 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.243858 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.243985 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.244155 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.244290 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.244461 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.244596 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.244761 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.244897 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.245064 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.245190 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.245362 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.245490 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.245664 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.245789 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.245960 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.246123 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.246268 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.246399 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.246638 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.246794 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.246920 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.247045 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.247226 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.247352 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.247487 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.247626 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.247772 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.247907 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.248082 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.248209 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.248380 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.248515 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.248680 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.248815 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.248979 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.249106 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.249300 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.249436 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.249611 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.249736 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.249945 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.250070 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.250257 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.250393 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.250574 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.250702 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.250883 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.251018 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.251220 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.251352 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.251520 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.251646 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.251830 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.251958 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.252137 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.252265 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.252443 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.252571 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.252750 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.252876 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.253069 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.253199 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.253379 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.253501 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.253683 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.253794 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.254071 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.254826 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.254954 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.255170 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.255309 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.260030 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.260163 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.260245 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.260322 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.260399 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.260475 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.260562 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.260640 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.260717 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.260793 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.260869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.260999 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.261095 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.261175 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.261251 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.261327 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.261404 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.261488 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.261573 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.261660 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.261738 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.261854 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.261938 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.262025 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.262104 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.262180 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.262256 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.262332 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.262408 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.262497 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.262582 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.262660 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.262739 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.262822 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.262937 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.263030 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.263149 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.263242 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.263365 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.263452 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.263530 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.263615 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.263694 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.263770 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.263846 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.263922 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.264016 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.264145 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.264227 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.264311 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.264389 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.264514 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.264605 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.264684 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.264768 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.264846 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.264922 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.264999 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.265083 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.265167 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.265245 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.265321 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.265397 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.265472 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.265557 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.265635 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.265710 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.265786 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.265862 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.265950 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.266028 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.266105 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.266187 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.266329 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.266481 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.266642 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.266783 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.266949 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.267081 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.267287 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.267397 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.267589 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.267702 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.267905 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.268019 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.268226 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.268309 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.268535 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.268670 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.268853 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.268982 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.269170 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.269306 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.269474 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.270788 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.270942 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.271061 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.271229 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.271370 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.271498 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.271623 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.271747 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.271870 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.271993 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.272196 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.272323 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.272446 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.272569 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.272700 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.272825 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.272957 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.273081 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.273206 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.273391 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.273516 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.273638 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.273770 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.273894 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.274015 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.274136 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.274259 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.274393 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.274516 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.274677 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.274835 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.274945 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.275069 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.275218 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.275353 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.275478 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.275478 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.275725 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.275850 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.275981 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.276106 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.276228 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.276359 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.276488 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.276619 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.276752 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.276883 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.277007 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.277137 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.277301 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.277440 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.277608 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.277738 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.277911 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.278040 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.278217 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.278429 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.278576 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.278783 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.279074 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.279240 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.279429 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.279576 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.279746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.279871 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.280065 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.280200 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.280384 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.280523 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.280711 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.280847 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.281037 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.281158 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.281374 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.281507 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.281678 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.281812 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.281986 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.282123 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.282289 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.282425 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.282591 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.282731 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.282892 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.283020 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.283218 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.283345 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.283522 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.283661 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.283822 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.283949 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.284120 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.284258 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.284410 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.284533 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.284709 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.284838 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.285005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.285138 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.285364 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.285494 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.285663 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.285787 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.285980 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.286093 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.286290 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.286403 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.286593 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.286715 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.286892 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.287003 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.287231 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.287348 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.287534 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.287646 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.287834 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.291331 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.291331 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.291519 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.291519 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.291675 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.291761 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.291848 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.291934 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.292061 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.292183 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.292270 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.292347 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.292439 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.292518 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.292595 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.292672 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.292747 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.292832 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.292923 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293002 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293091 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293179 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293258 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293258 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293407 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293483 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293559 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293635 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293711 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293794 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293872 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.293956 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.294041 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.294126 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.294204 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.294288 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.294362 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.294427 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.294509 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.294594 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.294731 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.294814 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.294904 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.294982 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.295067 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.295186 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.295342 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.295424 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.295500 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.295575 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.295652 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.295728 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.295812 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.295897 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.295975 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.296190 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.296277 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.296491 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.296627 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.296789 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.296874 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.297089 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.297214 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.297404 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.297498 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.297712 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.297845 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.298010 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.298093 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.298310 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.298401 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.298605 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.298689 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.298909 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.298992 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.299232 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.299332 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.299533 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.299618 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.299848 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.299933 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.300149 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.300233 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.300446 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.300538 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.300746 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.301376 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.301566 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.301667 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.301867 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.301959 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.302164 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.302304 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.302468 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.302555 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.302799 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.302882 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.303101 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.303227 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.303432 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.303516 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.303736 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.303829 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.304035 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.304132 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.304336 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.304443 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.304642 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.304734 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.304933 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.305039 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.305227 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.305564 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.305775 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.305860 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.306074 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.306166 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.306372 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.306456 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.306675 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.306768 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.306981 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.307065 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.307305 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.307390 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.307605 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.307691 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.307904 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.307988 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.308199 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.308290 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.308534 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.308627 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.308831 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.308957 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.309175 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.309297 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.309489 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.309587 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.309803 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.309889 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.310112 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.310196 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.310420 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.310517 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.310727 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.310812 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.311028 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.311130 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.311348 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.311449 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.311659 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.311751 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.311965 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.312057 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.312264 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.312399 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.312561 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.312644 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.312859 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.312945 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.313172 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.313257 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.313473 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.313556 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.313778 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.313862 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.314093 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.314186 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.314411 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.314538 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.314714 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.314842 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.315023 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.315183 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.315357 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.315486 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.315663 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.315791 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.315970 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.316099 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.316279 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.316393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.317162 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.317281 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.317482 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.317639 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.317799 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.317954 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.318117 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.318267 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.318429 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.318577 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.318736 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.318884 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.319044 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.323099 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.323312 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.323396 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.323474 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.323550 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.323627 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.323724 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.323804 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.323895 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.323973 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.324057 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.324142 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.324221 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.324298 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.324375 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.324452 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.324536 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.324622 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.324736 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.324736 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.324894 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.324894 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.325041 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.325128 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.325213 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.325291 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.325368 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.325444 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.325520 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.325609 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.325688 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.325808 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.325893 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.325971 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.326116 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.326196 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.326280 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.326358 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.326435 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.326519 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.326606 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.326685 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.326762 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.326839 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.326916 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.326993 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.327078 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.327174 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.327253 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.327330 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.327406 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.327482 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.327575 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.327655 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.327733 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.327810 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.327893 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.327979 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.328064 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.328222 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.328366 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.328525 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.328683 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.328842 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.328983 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.329256 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.329341 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.329568 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.329695 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.329873 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.330002 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.330289 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.330375 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.330654 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.330815 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.330953 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.331087 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.331267 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.331394 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.331559 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.331699 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.331882 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.332010 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.332230 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.332549 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.332694 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.332861 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.332991 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.333185 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.333314 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.333511 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.333640 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.333824 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.333952 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.334139 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.334279 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.334444 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.334572 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.334754 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.334880 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.335081 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.335244 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.335378 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.335503 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.335695 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.335824 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.336007 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.336137 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.336327 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.336454 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.336722 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.336857 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.337042 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.337178 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.337354 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.337516 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.337678 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.337799 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.337952 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.338077 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.338267 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.338395 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.338572 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.338709 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.338878 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.339006 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.339203 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.339333 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.339510 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.339650 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.339820 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.339954 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.340118 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.340251 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.340424 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.340559 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.340725 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.340852 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.341026 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.341159 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.341326 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.341469 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.341625 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.341745 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.341943 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.342076 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.342257 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.342394 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.342572 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.342697 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.342882 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.343010 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.343208 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.343338 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.343531 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.343659 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.343831 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.343966 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.344134 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.344260 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.344439 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.344566 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.344740 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.344875 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.345052 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.345179 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.345399 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.345533 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.345689 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.345817 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.346007 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.346120 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.346323 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.346444 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.346632 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.346753 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.346962 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.347077 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.347299 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.347412 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.351711 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.351805 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.351930 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.352018 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.352097 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.352175 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.352265 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.352354 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.352433 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.352519 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.352783 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.352905 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.353021 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.353130 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.353216 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.353295 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.353405 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.353499 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.353588 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.353674 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.353753 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.353837 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.353916 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.354002 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.354089 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.354175 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.354253 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.354369 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.354456 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.354544 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.354675 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.354758 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.354836 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.354914 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.354987 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.355062 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.355184 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.355267 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.355344 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.355421 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.355497 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.355583 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.355663 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.355740 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.355816 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.355899 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.355986 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.356066 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.356151 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.356237 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.356316 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.356393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.356479 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.356558 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.356635 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.356712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.356789 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.356866 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.356955 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.357035 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.357112 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.357193 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.357272 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.357349 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.357433 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.357518 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.357597 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.357752 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.357882 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.358064 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.358198 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.358374 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.358507 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.358684 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.358813 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.358990 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.359146 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.359321 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.359631 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.359715 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.359943 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.360041 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.360282 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.360504 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.360596 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.360829 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.360914 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.361140 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.361227 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.361448 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.361533 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.361755 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.361848 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.362065 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.362149 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.362371 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.362455 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.362675 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.362772 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.362979 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.363064 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.363852 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.363969 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.364210 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.364371 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.364549 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.364710 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.364868 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.365037 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.365174 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.365365 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.365497 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.365701 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.365830 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.366021 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.366222 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.366369 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.366493 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.366710 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.366838 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.367024 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.367193 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.367366 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.367495 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.367680 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.367808 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.367995 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.368124 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.368306 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.368433 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.368617 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.368752 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.368924 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.369058 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.369231 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.369358 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.369534 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.369670 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.369846 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.369974 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.370156 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.370297 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.370461 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.370599 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.370794 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.370925 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.371149 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.371279 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.371437 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.371576 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.371750 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.371872 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.372065 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.372186 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.372449 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.372562 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.372760 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.372882 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.373072 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.373186 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.373421 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.373535 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.373812 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.373925 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.374128 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.374242 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.374443 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.374568 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.374768 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.374882 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.375070 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.380489 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.380620 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.380717 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.380810 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.380896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.380975 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.381061 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.381140 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.381218 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.381303 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.381383 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.381460 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.381549 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.381629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.381706 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.381783 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.381859 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.381936 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.382021 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.382021 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.382163 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.382276 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.382360 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.382448 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.382528 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.382605 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.382681 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.382758 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.382835 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.382835 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.383028 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.383192 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.383285 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.383365 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.383431 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.383516 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.383601 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.383679 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.383763 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.383841 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.383924 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384010 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384089 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384166 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384243 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384328 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384414 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384494 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384571 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384647 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384724 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384807 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384894 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.384972 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.385049 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.385126 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.385202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.385285 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.385364 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.385442 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.385519 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.385601 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.385679 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.385756 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.385845 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.385924 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.386001 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.386077 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.386160 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.386246 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.386324 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.386409 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.386488 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.386719 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.386815 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.387030 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.387139 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.387357 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.387445 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.387660 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.387748 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.387960 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.388046 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.388270 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.388355 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.388571 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.388664 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.388878 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.388966 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.389201 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.389285 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.389508 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.389603 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.389809 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.389894 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.390114 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.390200 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.390426 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.390518 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.390736 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.390820 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.391051 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.391169 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.391375 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.391471 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.391687 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.391771 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.391991 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.392082 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.392308 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.392402 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.392617 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.392848 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.392941 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.393178 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.393335 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.393499 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.393592 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.393831 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.394058 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.394145 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.394387 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.394472 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.395393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.395555 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.395685 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.395889 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.396027 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.396193 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.396326 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.396498 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.396627 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.396799 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.396939 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.397116 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.397254 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.397429 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.397563 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.397736 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.397863 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.398042 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.398170 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.398349 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.398476 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.398656 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.398792 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.398963 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.399091 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.399291 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.399428 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.399600 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.399728 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.399910 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.400038 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.400223 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.400361 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.400529 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.400656 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.400834 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.400961 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.401145 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.401283 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.401468 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.401595 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.401784 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.401911 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.402093 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.402236 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.402410 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.402543 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.402720 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.402846 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.403023 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.403172 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.403357 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.403485 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.403662 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.403806 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.403983 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.404111 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.404288 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.404469 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.404603 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.404728 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.404904 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.405032 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.405206 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.405334 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.405616 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.405752 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.405934 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.406054 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.406249 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.406364 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.406570 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.406692 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.406878 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.406991 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.407219 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.407337 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.411804 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.411951 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.411951 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.412155 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.412238 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.412316 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.412406 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.412487 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.412606 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.412700 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.412780 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.412857 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.412947 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.413033 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.413033 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.413183 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.413260 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.413337 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.413337 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.413540 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.413626 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.413745 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.413830 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.413908 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.413995 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.414073 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.414150 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.414227 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.414310 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.414397 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.414482 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.414561 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.414705 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.414787 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.414911 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.415003 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.415083 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.415213 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.415294 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.415412 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.415496 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.415587 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.415720 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.415804 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.415882 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.415960 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.416043 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.416134 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.416214 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.416297 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.416382 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.416460 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.416546 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.416625 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.416702 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.416778 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.416862 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.416948 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.417035 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.417114 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.417231 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.417317 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.417403 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.417535 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.417627 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.417706 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.417784 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.417860 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.417937 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.418023 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.418102 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.418302 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.418391 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.418620 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.418705 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.418934 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.419021 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.419270 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.419358 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.419576 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.419673 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.419890 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.419975 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.420196 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.420281 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.420505 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.420589 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.420808 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.420894 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.421118 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.421201 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.421426 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.421517 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.421778 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.421869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.422036 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.422129 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.422342 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.422502 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.422643 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.422735 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.422947 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.423040 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.423293 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.423391 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.423616 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.423702 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.423927 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.424027 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.424245 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.424338 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.424555 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.424639 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.424862 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.424953 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.425171 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.425257 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.425478 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.425564 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.425785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.426388 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.426607 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.426823 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.426952 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.427162 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.427294 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.427479 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.427622 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.427796 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.427931 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.428113 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.428247 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.428424 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.428552 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.428745 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.428874 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.429081 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.429208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.429477 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.429630 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.429766 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.429892 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.430029 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.430156 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.430594 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.430724 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.430919 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.431053 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.431272 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.431412 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.431589 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.431718 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.431897 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.432024 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.432201 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.432336 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.432469 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103206) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 21:59:40.432603 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 21:59:40.432735 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103205) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 21:59:40.455738 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_db.sqlalchemy.engines [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 21:59:40.458309 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 21:59:40.520602 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.context [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8de9a745-abfa-4d62-8186-d36fd3c28976(cell1) {{(pid=103206) load_cells /opt/stack/nova/nova/context.py:464}} May 17 21:59:40.522551 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.context [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8de9a745-abfa-4d62-8186-d36fd3c28976(cell1) {{(pid=103205) load_cells /opt/stack/nova/nova/context.py:464}} May 17 21:59:40.524972 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 21:59:40.526559 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 21:59:40.526892 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 21:59:40.527386 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 21:59:40.528518 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 21:59:40.529311 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 21:59:40.529400 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 21:59:40.531301 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG oslo_concurrency.lockutils [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103205) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 21:59:40.540626 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_db.sqlalchemy.engines [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 21:59:40.543870 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_db.sqlalchemy.engines [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 21:59:40.547626 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 21:59:40.551445 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 21:59:40.704515 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_db.sqlalchemy.engines [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103206) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 21:59:40.712181 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103205) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 21:59:41.132281 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: WARNING keystonemiddleware.auth_token [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 21:59:41.139689 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: WARNING keystonemiddleware.auth_token [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 21:59:41.166792 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: WARNING keystonemiddleware.auth_token [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 21:59:41.174096 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: WARNING keystonemiddleware.auth_token [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 21:59:41.484410 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: WARNING keystonemiddleware.auth_token [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 21:59:41.491285 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: WARNING keystonemiddleware.auth_token [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 21:59:41.497251 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b0570c29c0 pid: 103206 (default app) May 17 21:59:41.499321 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 21:59:41.500506 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001754 May 17 21:59:41.500919 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 788 bytes} [Tue May 17 21:59:41 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 21:59:41.516326 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: WARNING keystonemiddleware.auth_token [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 21:59:41.522534 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: WARNING keystonemiddleware.auth_token [None req-b5b88385-df3f-463a-9963-3a8b9ae8ca37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 21:59:41.528603 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b0570c29c0 pid: 103205 (default app) May 17 22:01:02.918301 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:02.919468 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 May 17 22:01:02.920129 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 2/2] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:03.356790 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-605f8351-e37b-445b-b83b-aa3cf3da9528 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:03.386607 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-605f8351-e37b-445b-b83b-aa3cf3da9528 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.459179 May 17 22:01:03.387296 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 1/3] 10.222.0.24 () {60 vars in 1291 bytes} [Tue May 17 22:01:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:01:05.713554 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:05.714556 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-a7262f6f-9be9-4cab-b075-d2e01402a475 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 17 22:01:05.714968 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 3/4] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:05.775592 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-93ac0e72-9695-4f0b-be38-7c8f76a17045 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "ram": 256, "vcpus": 1, "id": "c1"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:05.793703 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 22:01:05.793703 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: warnings.warn(msg) May 17 22:01:05.913745 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-93ac0e72-9695-4f0b-be38-7c8f76a17045 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.192579 May 17 22:01:05.914652 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 2/5] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 17 22:01:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 22:01:06.134664 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-353385b6-6fbf-4ce2-a754-4ec4be94a84a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:06.137218 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 22:01:06.137218 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: warnings.warn(msg) May 17 22:01:06.240266 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-353385b6-6fbf-4ce2-a754-4ec4be94a84a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.317961 May 17 22:01:06.240925 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 4/6] 10.222.0.24 () {64 vars in 1335 bytes} [Tue May 17 22:01:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:01:08.584886 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-93ac0e72-9695-4f0b-be38-7c8f76a17045 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:08.585899 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-93ac0e72-9695-4f0b-be38-7c8f76a17045 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 17 22:01:08.586294 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 3/7] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:08.705431 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-b4cd2ff7-7537-4ac5-816c-47b0245f1596 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "swap": 0, "name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:08.727651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 22:01:08.727651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: warnings.warn(msg) May 17 22:01:08.849292 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-b4cd2ff7-7537-4ac5-816c-47b0245f1596 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.256094 May 17 22:01:08.850075 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 5/8] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 17 22:01:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:01:08.864441 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-9f9d11dc-5bd9-4e9b-b9b5-4a71d12aba7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:08.868079 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 22:01:08.868079 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: warnings.warn(msg) May 17 22:01:09.000906 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-9f9d11dc-5bd9-4e9b-b9b5-4a71d12aba7b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141117 May 17 22:01:09.001364 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 4/9] 10.222.0.24 () {64 vars in 1335 bytes} [Tue May 17 22:01:08 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:01:11.337795 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-b4cd2ff7-7537-4ac5-816c-47b0245f1596 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:11.338871 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-b4cd2ff7-7537-4ac5-816c-47b0245f1596 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 May 17 22:01:11.339628 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 6/10] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:11.403038 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-70f6ba90-f95d-4f7a-ac6f-9131ed7182d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "id": "d2", "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds1G"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:11.466381 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-70f6ba90-f95d-4f7a-ac6f-9131ed7182d5 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.119609 May 17 22:01:11.467269 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 5/11] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 17 22:01:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:01:11.479886 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-3d48159b-d4cd-49a1-b84e-cd9c446184cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:11.571420 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-3d48159b-d4cd-49a1-b84e-cd9c446184cd admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095180 May 17 22:01:11.572191 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 7/12] 10.222.0.24 () {64 vars in 1335 bytes} [Tue May 17 22:01:11 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:01:13.857444 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-70f6ba90-f95d-4f7a-ac6f-9131ed7182d5 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:13.858497 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-70f6ba90-f95d-4f7a-ac6f-9131ed7182d5 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 17 22:01:13.858928 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 6/13] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:13.919472 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-883788b3-9094-409e-99ea-52d34e368d15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:13.996287 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-883788b3-9094-409e-99ea-52d34e368d15 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131414 May 17 22:01:13.996842 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 8/14] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 17 22:01:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:01:14.009519 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-a2834562-e8be-4353-adc0-0687b3ee737d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:14.081685 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-a2834562-e8be-4353-adc0-0687b3ee737d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075904 May 17 22:01:14.082262 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 7/15] 10.222.0.24 () {64 vars in 1335 bytes} [Tue May 17 22:01:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:01:16.430622 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-883788b3-9094-409e-99ea-52d34e368d15 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:16.432048 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-883788b3-9094-409e-99ea-52d34e368d15 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001894 May 17 22:01:16.432559 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 9/16] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:16.495151 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-5f1b37ec-7cfc-41a6-b54e-2ea6fb904597 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:16.597229 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-5f1b37ec-7cfc-41a6-b54e-2ea6fb904597 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158355 May 17 22:01:16.598344 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 8/17] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 17 22:01:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:01:16.610687 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-07488a21-e584-472e-9b05-dae2d4bcb544 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:16.689447 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-07488a21-e584-472e-9b05-dae2d4bcb544 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082634 May 17 22:01:16.690325 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 10/18] 10.222.0.24 () {64 vars in 1335 bytes} [Tue May 17 22:01:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:01:19.014087 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-5f1b37ec-7cfc-41a6-b54e-2ea6fb904597 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:19.015097 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-5f1b37ec-7cfc-41a6-b54e-2ea6fb904597 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 17 22:01:19.015520 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 9/19] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:19.074856 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-6e82cb9a-8ace-4122-8b6b-e377ddf5ce0c admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:19.098324 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-6e82cb9a-8ace-4122-8b6b-e377ddf5ce0c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076002 May 17 22:01:19.098860 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 11/20] 10.222.0.24 () {60 vars in 1291 bytes} [Tue May 17 22:01:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:01:21.937897 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-5f1b37ec-7cfc-41a6-b54e-2ea6fb904597 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:21.938957 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-5f1b37ec-7cfc-41a6-b54e-2ea6fb904597 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 17 22:01:21.939420 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 10/21] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:22.003678 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-81c1641b-c935-4b27-bd42-2e46c12d8ac5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "disk": 1, "id": "1"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:22.096277 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-81c1641b-c935-4b27-bd42-2e46c12d8ac5 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.150357 May 17 22:01:22.096972 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 12/22] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 17 22:01:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:01:22.111178 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-822714c1-d762-4c58-8a58-7aa88f58d8b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:22.178770 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-822714c1-d762-4c58-8a58-7aa88f58d8b3 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071427 May 17 22:01:22.182036 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 11/23] 10.222.0.24 () {64 vars in 1332 bytes} [Tue May 17 22:01:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:01:25.053810 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-81c1641b-c935-4b27-bd42-2e46c12d8ac5 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:25.055395 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-81c1641b-c935-4b27-bd42-2e46c12d8ac5 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 May 17 22:01:25.055896 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 13/24] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:25.121465 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-17254391-40d4-4929-90aa-fe24f653533f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:25.201262 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-17254391-40d4-4929-90aa-fe24f653533f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.137296 May 17 22:01:25.201734 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 12/25] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 17 22:01:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:01:25.219680 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-91534856-6b12-4d67-9a02-5f90ac50d54e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:25.378223 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-91534856-6b12-4d67-9a02-5f90ac50d54e admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.164267 May 17 22:01:25.378963 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 14/26] 10.222.0.24 () {64 vars in 1332 bytes} [Tue May 17 22:01:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:01:27.731413 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-17254391-40d4-4929-90aa-fe24f653533f admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:27.732426 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-17254391-40d4-4929-90aa-fe24f653533f admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 17 22:01:27.732825 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 13/27] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:27.791099 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-bf5b0e22-523e-4890-98f5-07ba8846d232 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "name": "m1.medium"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:27.869844 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-bf5b0e22-523e-4890-98f5-07ba8846d232 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.130510 May 17 22:01:27.870496 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 15/28] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 17 22:01:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 22:01:27.885329 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-217ec03e-bf93-411c-a887-aef2a82ed4c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:27.948422 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-217ec03e-bf93-411c-a887-aef2a82ed4c9 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068908 May 17 22:01:27.954099 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 14/29] 10.222.0.24 () {64 vars in 1332 bytes} [Tue May 17 22:01:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:01:30.245989 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-bf5b0e22-523e-4890-98f5-07ba8846d232 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:30.247710 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-bf5b0e22-523e-4890-98f5-07ba8846d232 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002156 May 17 22:01:30.248112 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 16/30] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:30.313871 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-99fa377f-3726-467d-a1ba-41dc30dd73f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "disk": 80}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:30.401997 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-99fa377f-3726-467d-a1ba-41dc30dd73f5 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.147905 May 17 22:01:30.403051 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 15/31] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 17 22:01:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:01:30.415062 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-d0169088-36be-44e3-8648-1fdbcc9809ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:30.492474 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-d0169088-36be-44e3-8648-1fdbcc9809ca admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081089 May 17 22:01:30.493349 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 17/32] 10.222.0.24 () {64 vars in 1332 bytes} [Tue May 17 22:01:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:01:32.861187 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-99fa377f-3726-467d-a1ba-41dc30dd73f5 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:32.862792 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-99fa377f-3726-467d-a1ba-41dc30dd73f5 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 May 17 22:01:32.863275 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 16/33] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:32.924209 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-b485d9eb-d14e-477e-abe5-0e8667b13ae6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "swap": 0, "vcpus": 8}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:32.996620 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-b485d9eb-d14e-477e-abe5-0e8667b13ae6 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.127578 May 17 22:01:32.997526 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 18/34] 10.222.0.24 () {64 vars in 1282 bytes} [Tue May 17 22:01:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 22:01:33.009500 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-56cfbb91-7cc6-40b8-8bd1-5caf3484d987 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:01:33.088911 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-56cfbb91-7cc6-40b8-8bd1-5caf3484d987 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083105 May 17 22:01:33.089827 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 17/35] 10.222.0.24 () {64 vars in 1332 bytes} [Tue May 17 22:01:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:01:56.314478 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-b485d9eb-d14e-477e-abe5-0e8667b13ae6 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:56.315627 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-b485d9eb-d14e-477e-abe5-0e8667b13ae6 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 17 22:01:56.316018 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 19/36] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:01:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:56.372211 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-4e97c77a-7c08-4760-a7b3-907834362d9f admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:56.390405 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-4e97c77a-7c08-4760-a7b3-907834362d9f admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068307 May 17 22:01:56.390904 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 18/37] 10.222.0.24 () {60 vars in 1291 bytes} [Tue May 17 22:01:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:01:57.400123 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-b485d9eb-d14e-477e-abe5-0e8667b13ae6 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:57.401115 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-b485d9eb-d14e-477e-abe5-0e8667b13ae6 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 17 22:01:57.401504 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 20/38] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 17 22:01:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:57.612527 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-13b742fe-2970-40a2-a500-0bff7ec86e83 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:57.617957 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.wsgi [None req-13b742fe-2970-40a2-a500-0bff7ec86e83 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-13b742fe-2970-40a2-a500-0bff7ec86e83 admin admin] Request method failure captured: May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Accept: application/json May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Accept-Encoding: gzip, deflate May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Connection: keep-alive May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Content-Length: 0 May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Host: 10.222.0.24 May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Openstack-Api-Version: compute 2.90 May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Openstack-System-Scope: None May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: User-Agent: python-novaclient May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Auth-Token: gAAAAABihBtVdXUReXe0gOXxwcNkNKrUpB_CHSiSX3TcO1VZdbPZgTc8f-pf1XUg0cB71PJzvzXH68Ho9cdzPyVk4mCYz0ulZXQlPEp75utifMnLTytC5KbhDBThtnK8w0w-onkdf3HxFyrEpDNXDBzodvKPPGuJeXt8GfV086ib6zCnCYi3AZw May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Domain-Id: None May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Domain-Name: None May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Identity-Status: Confirmed May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Is-Admin-Project: True May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Openstack-Nova-Api-Version: 2.90 May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Project-Domain-Id: default May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Project-Domain-Name: Default May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Project-Id: 52a8a72ae1784555b539c1867c54411c May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Project-Name: admin May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Role: reader,admin,member May 17 22:01:57.621208 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Roles: reader,admin,member May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_52a8a72ae1784555b539c1867c54411c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Tenant: admin May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Tenant-Id: 52a8a72ae1784555b539c1867c54411c May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Tenant-Name: admin May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User: admin May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User-Domain-Id: default May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User-Domain-Name: Default May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User-Id: aced3dd744eb487b932a627079853c51 May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User-Name: admin May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: method: > May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: exception: Flavor 42 could not be found. May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: action_args: {'id': '42'} May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:01:57.622869 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:01:57.623920 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:57.625712 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-13b742fe-2970-40a2-a500-0bff7ec86e83 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103205) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:01:57.626847 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-13b742fe-2970-40a2-a500-0bff7ec86e83 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059635 May 17 22:01:57.626847 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 19/39] 10.222.0.24 () {60 vars in 1190 bytes} [Tue May 17 22:01:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 22:01:57.633086 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-58dc62a0-ff45-4ff8-8720-892aa2decb9a admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:57.655562 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-58dc62a0-ff45-4ff8-8720-892aa2decb9a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026323 May 17 22:01:57.656122 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 21/40] 10.222.0.24 () {60 vars in 1210 bytes} [Tue May 17 22:01:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:01:57.666036 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-ab83e50c-06ed-4805-b2bd-a92657e32f04 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:57.687961 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-ab83e50c-06ed-4805-b2bd-a92657e32f04 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024822 May 17 22:01:57.688502 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 20/41] 10.222.0.24 () {60 vars in 1210 bytes} [Tue May 17 22:01:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:01:57.697722 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-07492cb8-7c64-42bf-acad-aee26a56c05d admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:57.704184 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.wsgi [None req-07492cb8-7c64-42bf-acad-aee26a56c05d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-07492cb8-7c64-42bf-acad-aee26a56c05d admin admin] Request method failure captured: May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Accept: application/json May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Accept-Encoding: gzip, deflate May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Connection: keep-alive May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Content-Length: 0 May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Host: 10.222.0.24 May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Openstack-Api-Version: compute 2.90 May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Openstack-System-Scope: None May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: User-Agent: python-novaclient May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Auth-Token: gAAAAABihBtVdXUReXe0gOXxwcNkNKrUpB_CHSiSX3TcO1VZdbPZgTc8f-pf1XUg0cB71PJzvzXH68Ho9cdzPyVk4mCYz0ulZXQlPEp75utifMnLTytC5KbhDBThtnK8w0w-onkdf3HxFyrEpDNXDBzodvKPPGuJeXt8GfV086ib6zCnCYi3AZw May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Domain-Id: None May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Domain-Name: None May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Identity-Status: Confirmed May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Is-Admin-Project: True May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Openstack-Nova-Api-Version: 2.90 May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Project-Domain-Id: default May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Project-Domain-Name: Default May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Project-Id: 52a8a72ae1784555b539c1867c54411c May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Project-Name: admin May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Role: reader,admin,member May 17 22:01:57.707385 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Roles: reader,admin,member May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_52a8a72ae1784555b539c1867c54411c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Tenant: admin May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Tenant-Id: 52a8a72ae1784555b539c1867c54411c May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Tenant-Name: admin May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User: admin May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User-Domain-Id: default May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User-Domain-Name: Default May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User-Id: aced3dd744eb487b932a627079853c51 May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User-Name: admin May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: method: > May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: exception: Flavor 42 could not be found. May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: action_args: {'id': '42'} May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:01:57.708785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:01:57.709704 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:01:57.710946 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-07492cb8-7c64-42bf-acad-aee26a56c05d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:01:57.711977 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-07492cb8-7c64-42bf-acad-aee26a56c05d admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014628 May 17 22:01:57.711977 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 22/42] 10.222.0.24 () {60 vars in 1190 bytes} [Tue May 17 22:01:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 17 22:01:58.592451 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-ab83e50c-06ed-4805-b2bd-a92657e32f04 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:58.593652 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-ab83e50c-06ed-4805-b2bd-a92657e32f04 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 17 22:01:58.594212 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 21/43] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 17 22:01:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:58.790354 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-4b1ab1ef-1fa7-4b3b-9026-cc35b5798351 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:58.795530 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.wsgi [None req-4b1ab1ef-1fa7-4b3b-9026-cc35b5798351 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-4b1ab1ef-1fa7-4b3b-9026-cc35b5798351 admin admin] Request method failure captured: May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Accept: application/json May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Accept-Encoding: gzip, deflate May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Connection: keep-alive May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Content-Length: 0 May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Host: 10.222.0.24 May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Openstack-Api-Version: compute 2.90 May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Openstack-System-Scope: None May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: User-Agent: python-novaclient May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Auth-Token: gAAAAABihBtWePT3F4-f878l8tkfQnxMPFpP7dEFIJBZ95TUKZJgGaRI7L3wktr9vSTTyt-svASt3E0R-PwKoE1CUK5QacxAWWC1Alb0zPlYkMqFqiD-IlMsmPd4p8tHpk1Kg7EJMtJErRWqPYT8hZBnvwzXUCxzkF2Qr0aX_Y3JbBC8jaVIqg8 May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Domain-Id: None May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Domain-Name: None May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Identity-Status: Confirmed May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Is-Admin-Project: True May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Openstack-Nova-Api-Version: 2.90 May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Project-Domain-Id: default May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Project-Domain-Name: Default May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Project-Id: 52a8a72ae1784555b539c1867c54411c May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Project-Name: admin May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Role: reader,admin,member May 17 22:01:58.797629 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Roles: reader,admin,member May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_52a8a72ae1784555b539c1867c54411c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Tenant: admin May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Tenant-Id: 52a8a72ae1784555b539c1867c54411c May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Tenant-Name: admin May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User: admin May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User-Domain-Id: default May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User-Domain-Name: Default May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User-Id: aced3dd744eb487b932a627079853c51 May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User-Name: admin May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: method: > May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: exception: Flavor 84 could not be found. May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: action_args: {'id': '84'} May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:01:58.799228 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:01:58.800271 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:01:58.801651 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-4b1ab1ef-1fa7-4b3b-9026-cc35b5798351 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:01:58.803058 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-4b1ab1ef-1fa7-4b3b-9026-cc35b5798351 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067125 May 17 22:01:58.803058 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 23/44] 10.222.0.24 () {60 vars in 1190 bytes} [Tue May 17 22:01:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 22:01:58.808871 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-7f9dea8b-bed0-4e36-9efd-42edfbc771c7 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:58.822987 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-7f9dea8b-bed0-4e36-9efd-42edfbc771c7 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017976 May 17 22:01:58.823541 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 22/45] 10.222.0.24 () {60 vars in 1210 bytes} [Tue May 17 22:01:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:01:58.833019 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-dd5c3f38-8ffe-4314-a364-4a96b35aa67c admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:58.847009 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-dd5c3f38-8ffe-4314-a364-4a96b35aa67c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017609 May 17 22:01:58.847553 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 24/46] 10.222.0.24 () {60 vars in 1210 bytes} [Tue May 17 22:01:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:01:58.856641 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-0e4fc1bf-fda5-431d-a6fc-d0437f676126 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:58.862510 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.wsgi [None req-0e4fc1bf-fda5-431d-a6fc-d0437f676126 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-0e4fc1bf-fda5-431d-a6fc-d0437f676126 admin admin] Request method failure captured: May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Accept: application/json May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Accept-Encoding: gzip, deflate May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Connection: keep-alive May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Content-Length: 0 May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Host: 10.222.0.24 May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Openstack-Api-Version: compute 2.90 May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Openstack-System-Scope: None May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: User-Agent: python-novaclient May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Auth-Token: gAAAAABihBtWePT3F4-f878l8tkfQnxMPFpP7dEFIJBZ95TUKZJgGaRI7L3wktr9vSTTyt-svASt3E0R-PwKoE1CUK5QacxAWWC1Alb0zPlYkMqFqiD-IlMsmPd4p8tHpk1Kg7EJMtJErRWqPYT8hZBnvwzXUCxzkF2Qr0aX_Y3JbBC8jaVIqg8 May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Domain-Id: None May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Domain-Name: None May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Identity-Status: Confirmed May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Is-Admin-Project: True May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Openstack-Nova-Api-Version: 2.90 May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Project-Domain-Id: default May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Project-Domain-Name: Default May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Project-Id: 52a8a72ae1784555b539c1867c54411c May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Project-Name: admin May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Role: reader,admin,member May 17 22:01:58.864005 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Roles: reader,admin,member May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_52a8a72ae1784555b539c1867c54411c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Tenant: admin May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Tenant-Id: 52a8a72ae1784555b539c1867c54411c May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Tenant-Name: admin May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User: admin May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User-Domain-Id: default May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User-Domain-Name: Default May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User-Id: aced3dd744eb487b932a627079853c51 May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User-Name: admin May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: method: > May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: exception: Flavor 84 could not be found. May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: action_args: {'id': '84'} May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:01:58.865580 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:01:58.866570 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:58.868202 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-0e4fc1bf-fda5-431d-a6fc-d0437f676126 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103205) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:01:58.869437 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-0e4fc1bf-fda5-431d-a6fc-d0437f676126 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012327 May 17 22:01:58.869437 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 23/47] 10.222.0.24 () {60 vars in 1190 bytes} [Tue May 17 22:01:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 17 22:01:59.749164 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-dd5c3f38-8ffe-4314-a364-4a96b35aa67c admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:59.750345 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-dd5c3f38-8ffe-4314-a364-4a96b35aa67c admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 May 17 22:01:59.750741 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 25/48] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 17 22:01:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:01:59.938149 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-c66f9df7-9434-4096-bb3b-b60c8524cdc8 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:59.943904 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.wsgi [None req-c66f9df7-9434-4096-bb3b-b60c8524cdc8 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-c66f9df7-9434-4096-bb3b-b60c8524cdc8 admin admin] Request method failure captured: May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Accept: application/json May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Accept-Encoding: gzip, deflate May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Connection: keep-alive May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Content-Length: 0 May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Host: 10.222.0.24 May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Openstack-Api-Version: compute 2.90 May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Openstack-System-Scope: None May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: User-Agent: python-novaclient May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Auth-Token: gAAAAABihBtXgliSxLOKOZ_6au8TxiMavcPfpUvXJgQAnup8j5Rr1vq2emoEOYVtqJej49BbOvJbTSr1B1BWcR4v98XwN9hQrmhf8ELLfx8lNCuZjb8hZTUbz7pihdiN1GpJ9D33YoAbv5BXROHaq7b3TZrM88fyfgPPjVf6arP_Nh2Q5ZhT-Qg May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Domain-Id: None May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Domain-Name: None May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Identity-Status: Confirmed May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Is-Admin-Project: True May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Openstack-Nova-Api-Version: 2.90 May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Project-Domain-Id: default May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Project-Domain-Name: Default May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Project-Id: 52a8a72ae1784555b539c1867c54411c May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Project-Name: admin May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Role: reader,admin,member May 17 22:01:59.945393 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Roles: reader,admin,member May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_52a8a72ae1784555b539c1867c54411c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Tenant: admin May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Tenant-Id: 52a8a72ae1784555b539c1867c54411c May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-Tenant-Name: admin May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User: admin May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User-Domain-Id: default May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User-Domain-Name: Default May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User-Id: aced3dd744eb487b932a627079853c51 May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: X-User-Name: admin May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: method: > May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: exception: Flavor 451 could not be found. May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: action_args: {'id': '451'} May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:01:59.946932 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:01:59.947896 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: ERROR nova.api.openstack.wsgi May 17 22:01:59.949177 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-c66f9df7-9434-4096-bb3b-b60c8524cdc8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103205) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:01:59.950378 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-c66f9df7-9434-4096-bb3b-b60c8524cdc8 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060145 May 17 22:01:59.950378 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 24/49] 10.222.0.24 () {60 vars in 1193 bytes} [Tue May 17 22:01:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 22:01:59.956986 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-ccf47d80-e5b2-432a-9fed-342667a2f45c admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:59.971249 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-ccf47d80-e5b2-432a-9fed-342667a2f45c admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018487 May 17 22:01:59.971690 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 26/50] 10.222.0.24 () {60 vars in 1210 bytes} [Tue May 17 22:01:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:01:59.980783 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:01:59.994037 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016705 May 17 22:01:59.994549 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 25/51] 10.222.0.24 () {60 vars in 1210 bytes} [Tue May 17 22:01:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:02:00.003568 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-8ba349d4-83af-49c1-883d-c60f64ed2b25 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:02:00.008608 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.wsgi [None req-8ba349d4-83af-49c1-883d-c60f64ed2b25 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-8ba349d4-83af-49c1-883d-c60f64ed2b25 admin admin] Request method failure captured: May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Accept: application/json May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Accept-Encoding: gzip, deflate May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Connection: keep-alive May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Content-Length: 0 May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Host: 10.222.0.24 May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Openstack-Api-Version: compute 2.90 May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Openstack-System-Scope: None May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: User-Agent: python-novaclient May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Auth-Token: gAAAAABihBtXgliSxLOKOZ_6au8TxiMavcPfpUvXJgQAnup8j5Rr1vq2emoEOYVtqJej49BbOvJbTSr1B1BWcR4v98XwN9hQrmhf8ELLfx8lNCuZjb8hZTUbz7pihdiN1GpJ9D33YoAbv5BXROHaq7b3TZrM88fyfgPPjVf6arP_Nh2Q5ZhT-Qg May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Domain-Id: None May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Domain-Name: None May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Identity-Status: Confirmed May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Is-Admin-Project: True May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Openstack-Nova-Api-Version: 2.90 May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Project-Domain-Id: default May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Project-Domain-Name: Default May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Project-Id: 52a8a72ae1784555b539c1867c54411c May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Project-Name: admin May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Role: reader,admin,member May 17 22:02:00.010116 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Roles: reader,admin,member May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_52a8a72ae1784555b539c1867c54411c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/52a8a72ae1784555b539c1867c54411c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Tenant: admin May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Tenant-Id: 52a8a72ae1784555b539c1867c54411c May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-Tenant-Name: admin May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User: admin May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User-Domain-Id: default May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User-Domain-Name: Default May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User-Id: aced3dd744eb487b932a627079853c51 May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: X-User-Name: admin May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: method: > May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: exception: Flavor 451 could not be found. May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: action_args: {'id': '451'} May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:02:00.011614 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:02:00.012508 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: ERROR nova.api.openstack.wsgi May 17 22:02:00.013746 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-8ba349d4-83af-49c1-883d-c60f64ed2b25 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103206) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:02:00.015790 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-8ba349d4-83af-49c1-883d-c60f64ed2b25 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011512 May 17 22:02:00.015790 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 27/52] 10.222.0.24 () {60 vars in 1193 bytes} [Tue May 17 22:01:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 17 22:02:00.904148 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:02:00.905187 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 17 22:02:00.906336 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 26/53] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 17 22:02:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:02:01.095442 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-ff922f52-5e6c-4612-a1d7-d358f73136e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:02:01.184393 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-ff922f52-5e6c-4612-a1d7-d358f73136e8 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.140441 May 17 22:02:01.184865 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 28/54] 10.222.0.24 () {64 vars in 1235 bytes} [Tue May 17 22:02:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:02:02.076691 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:02:02.077763 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 17 22:02:02.078238 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 27/55] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 17 22:02:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:02:02.275190 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-9e01bc6b-b4c5-44fb-9341-c98e5aa9a738 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:02:02.337458 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-9e01bc6b-b4c5-44fb-9341-c98e5aa9a738 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.120050 May 17 22:02:02.338005 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 29/56] 10.222.0.24 () {64 vars in 1235 bytes} [Tue May 17 22:02:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:02:03.240659 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:02:03.241639 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 17 22:02:03.242037 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 28/57] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 17 22:02:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:02:03.435715 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-af49a35f-cedf-48e4-8c69-03cf579d2c99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:02:03.503578 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-af49a35f-cedf-48e4-8c69-03cf579d2c99 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.119078 May 17 22:02:03.504049 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 30/58] 10.222.0.24 () {64 vars in 1235 bytes} [Tue May 17 22:02:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 22:02:04.389727 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:02:04.391401 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 May 17 22:02:04.391799 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 29/59] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 17 22:02:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:02:04.580480 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-057b51f1-1b7a-49b9-b8f5-6de3485cc6eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:02:04.658311 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-057b51f1-1b7a-49b9-b8f5-6de3485cc6eb admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.129857 May 17 22:02:04.658769 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 31/60] 10.222.0.24 () {64 vars in 1235 bytes} [Tue May 17 22:02:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 22:02:05.557113 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:02:05.558105 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 May 17 22:02:05.558499 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 30/61] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 17 22:02:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:02:05.745583 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-5c14e369-13f1-455f-82a3-771a446b6580 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:02:05.765446 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-5c14e369-13f1-455f-82a3-771a446b6580 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070449 May 17 22:02:05.766066 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 32/62] 10.222.0.24 () {60 vars in 1202 bytes} [Tue May 17 22:02:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:03:08.566581 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:03:08.567634 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-a6722450-d6da-4d7d-a7b8-5f9696dddb35 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 May 17 22:03:08.568030 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 31/63] 10.222.0.24 () {54 vars in 930 bytes} [Tue May 17 22:03:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:03:08.625396 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-78ded045-2431-4176-96c8-d204aaa67961 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:03:08.644883 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-78ded045-2431-4176-96c8-d204aaa67961 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070921 May 17 22:03:08.645413 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 33/64] 10.222.0.24 () {60 vars in 1291 bytes} [Tue May 17 22:03:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:03:08.668017 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-a297f23d-adaf-47cd-8861-86563e95ff65 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:03:08.675838 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-a297f23d-adaf-47cd-8861-86563e95ff65 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011975 May 17 22:03:08.676354 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 32/65] 10.222.0.24 () {60 vars in 1282 bytes} [Tue May 17 22:03:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:03:08.688048 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-eb97a6dd-fd38-4fa0-a067-6e49dd62afe5 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:03:08.695476 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-eb97a6dd-fd38-4fa0-a067-6e49dd62afe5 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011501 May 17 22:03:08.695981 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 34/66] 10.222.0.24 () {60 vars in 1285 bytes} [Tue May 17 22:03:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:03:08.707470 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-288729bc-2a95-414d-a6c7-45fdcc1e0263 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:03:08.714816 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-288729bc-2a95-414d-a6c7-45fdcc1e0263 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010857 May 17 22:03:08.715362 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 33/67] 10.222.0.24 () {60 vars in 1285 bytes} [Tue May 17 22:03:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:03:08.726243 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-143f154c-46a8-4e9e-a01b-6db76b753b8f admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:03:08.733741 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-143f154c-46a8-4e9e-a01b-6db76b753b8f admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010942 May 17 22:03:08.734197 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 35/68] 10.222.0.24 () {60 vars in 1282 bytes} [Tue May 17 22:03:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:06:51.091166 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-288729bc-2a95-414d-a6c7-45fdcc1e0263 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:06:51.092173 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-288729bc-2a95-414d-a6c7-45fdcc1e0263 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 17 22:06:51.092567 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 34/69] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 17 22:06:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:06:51.361908 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-a67c013e-6d66-4a20-8641-f17903c57f12 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:06:51.363158 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 22:06:51.363158 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: warnings.warn(msg) May 17 22:06:51.364382 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-a67c013e-6d66-4a20-8641-f17903c57f12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:06:51.364846 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-a67c013e-6d66-4a20-8641-f17903c57f12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:06:51.365631 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-a67c013e-6d66-4a20-8641-f17903c57f12 admin admin] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:06:51.366060 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-a67c013e-6d66-4a20-8641-f17903c57f12 admin admin] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:06:51.400390 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-a67c013e-6d66-4a20-8641-f17903c57f12 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150032 May 17 22:06:51.400971 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 36/70] 10.222.0.24 () {60 vars in 1193 bytes} [Tue May 17 22:06:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:06:52.340705 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-288729bc-2a95-414d-a6c7-45fdcc1e0263 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:06:52.341705 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-288729bc-2a95-414d-a6c7-45fdcc1e0263 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002227 May 17 22:06:52.342100 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 35/71] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 17 22:06:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:06:52.533716 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-88fe3f1a-7768-4beb-8163-a83f822737d1 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:06:52.534917 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 22:06:52.534917 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: warnings.warn(msg) May 17 22:06:52.536135 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-88fe3f1a-7768-4beb-8163-a83f822737d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:06:52.536571 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-88fe3f1a-7768-4beb-8163-a83f822737d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:06:52.537345 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-88fe3f1a-7768-4beb-8163-a83f822737d1 admin admin] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:06:52.537767 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-88fe3f1a-7768-4beb-8163-a83f822737d1 admin admin] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:06:52.556531 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-88fe3f1a-7768-4beb-8163-a83f822737d1 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074944 May 17 22:06:52.557074 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 37/72] 10.222.0.24 () {60 vars in 1193 bytes} [Tue May 17 22:06:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:07:03.865751 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-288729bc-2a95-414d-a6c7-45fdcc1e0263 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:07:03.866792 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-288729bc-2a95-414d-a6c7-45fdcc1e0263 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 17 22:07:03.867215 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 36/73] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 17 22:07:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:07:04.065268 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-722b38b1-2451-4e25-a6be-71708a7b1f4f admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:07:04.066461 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 22:07:04.066461 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: warnings.warn(msg) May 17 22:07:04.067991 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-722b38b1-2451-4e25-a6be-71708a7b1f4f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:07:04.068435 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-722b38b1-2451-4e25-a6be-71708a7b1f4f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:07:04.069218 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-722b38b1-2451-4e25-a6be-71708a7b1f4f admin admin] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:07:04.069643 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-722b38b1-2451-4e25-a6be-71708a7b1f4f admin admin] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:07:04.094301 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-722b38b1-2451-4e25-a6be-71708a7b1f4f admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084661 May 17 22:07:04.094785 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 38/74] 10.222.0.24 () {60 vars in 1193 bytes} [Tue May 17 22:07:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:07:05.005554 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: DEBUG nova.api.openstack.wsgi [None req-288729bc-2a95-414d-a6c7-45fdcc1e0263 admin admin] Calling method '>' {{(pid=103205) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:07:05.006551 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: INFO nova.api.openstack.requestlog [None req-288729bc-2a95-414d-a6c7-45fdcc1e0263 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 17 22:07:05.006937 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: [pid: 103205|app: 0|req: 37/75] 10.222.0.24 () {56 vars in 1074 bytes} [Tue May 17 22:07:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:07:05.196323 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG nova.api.openstack.wsgi [None req-293d4021-0a0d-4346-82e6-b8c15ce8a725 admin admin] Calling method '>' {{(pid=103206) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:07:05.197491 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 22:07:05.197491 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: warnings.warn(msg) May 17 22:07:05.198689 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-293d4021-0a0d-4346-82e6-b8c15ce8a725 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:07:05.199133 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-293d4021-0a0d-4346-82e6-b8c15ce8a725 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:07:05.199921 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-293d4021-0a0d-4346-82e6-b8c15ce8a725 admin admin] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:07:05.200345 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: DEBUG oslo_concurrency.lockutils [None req-293d4021-0a0d-4346-82e6-b8c15ce8a725 admin admin] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103206) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:07:05.222081 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: INFO nova.api.openstack.requestlog [None req-293d4021-0a0d-4346-82e6-b8c15ce8a725 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077145 May 17 22:07:05.222630 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: [pid: 103206|app: 0|req: 39/76] 10.222.0.24 () {60 vars in 1193 bytes} [Tue May 17 22:07:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:08:03.093034 dv-cinder-839987-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 17 22:08:03.093620 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: Tue May 17 22:08:03 2022 - graceful shutdown triggered... May 17 22:08:03.094119 dv-cinder-839987-6-iscsi devstack@n-api.service[103205]: Gracefully killing worker 1 (pid: 103205)... May 17 22:08:03.096249 dv-cinder-839987-6-iscsi devstack@n-api.service[103206]: Gracefully killing worker 2 (pid: 103206)... May 17 22:08:04.094695 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: worker 1 buried after 1 seconds May 17 22:08:04.094695 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: worker 2 buried after 1 seconds May 17 22:08:04.095284 dv-cinder-839987-6-iscsi devstack@n-api.service[103204]: goodbye to uWSGI. May 17 22:08:04.096249 dv-cinder-839987-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 17 22:08:04.096818 dv-cinder-839987-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 17 22:08:04.100226 dv-cinder-839987-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 22:08:04.115956 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 22:08:04.130761 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 22:08:04 2022] *** May 17 22:08:04.130761 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 22:08:04.130761 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 22:08:04.130761 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: nodename: dv-cinder-839987-6-iscsi May 17 22:08:04.130761 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: machine: x86_64 May 17 22:08:04.130761 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: clock source: unix May 17 22:08:04.130761 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: pcre jit disabled May 17 22:08:04.130761 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: detected number of CPU cores: 4 May 17 22:08:04.130761 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: current working directory: / May 17 22:08:04.130761 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: detected binary path: /usr/bin/uwsgi-core May 17 22:08:04.130761 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: your processes number limit is 47680 May 17 22:08:04.131655 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: your memory page size is 4096 bytes May 17 22:08:04.131655 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: detected max file descriptor number: 2048 May 17 22:08:04.131655 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: lock engine: pthread robust mutexes May 17 22:08:04.131655 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: thunder lock: enabled May 17 22:08:04.131655 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 22:08:04.131655 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 22:08:04.178498 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: Python main interpreter initialized at 0x561a5cc769c0 May 17 22:08:04.178498 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: python threads support enabled May 17 22:08:04.178498 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: your server socket listen backlog is limited to 100 connections May 17 22:08:04.178498 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: your mercy for graceful operations on workers is 90 seconds May 17 22:08:04.178910 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: mapped 403077 bytes (393 KB) for 2 cores May 17 22:08:04.178910 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: *** Operational MODE: preforking *** May 17 22:08:04.179129 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: *** uWSGI is running in multiple interpreter mode *** May 17 22:08:04.179129 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: spawned uWSGI master process (pid: 117578) May 17 22:08:04.179348 dv-cinder-839987-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 22:08:04.180423 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: spawned uWSGI worker 1 (pid: 117593, cores: 1) May 17 22:08:04.183029 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: spawned uWSGI worker 2 (pid: 117594, cores: 1) May 17 22:08:04.183029 dv-cinder-839987-6-iscsi devstack@n-api.service[117578]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 22:08:05.393984 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 22:08:05.398384 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 22:08:06.187846 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 22:08:06.187846 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: from cryptography.utils import int_from_bytes May 17 22:08:06.188150 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 22:08:06.188150 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: from cryptography.utils import int_from_bytes May 17 22:08:06.197369 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 22:08:06.197369 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: from cryptography.utils import int_from_bytes May 17 22:08:06.197845 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 22:08:06.197845 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: from cryptography.utils import int_from_bytes May 17 22:08:08.640155 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 22:08:08.640804 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 22:08:08.640804 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 22:08:08.641285 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 22:08:08.641379 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 22:08:08.641590 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 22:08:08.641799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 22:08:08.642011 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.642300 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.642407 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 22:08:08.642621 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.642730 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 22:08:08.642920 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 22:08:08.643034 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.643391 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.643506 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.643663 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.643764 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.643992 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.644100 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.644316 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.644414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.644654 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.644764 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.644954 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.645057 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.645272 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.645386 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.645596 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.645703 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839987-6-iscsi {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.645917 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.646026 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.646178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.646285 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.646526 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.646662 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.646823 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839987-6-iscsi {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.646929 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.647193 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.647307 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.647466 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.647576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.647770 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.647891 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.648244 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.648348 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.648454 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.655020 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.655893 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.656087 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.656262 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.656430 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.656626 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.656780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.656942 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.657091 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.657449 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.657612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.658955 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.659143 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.659310 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.659471 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.659621 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.659780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.659936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.660105 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.660267 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.660422 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.660596 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839987-6-iscsi {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.660747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.660903 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.661063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.661211 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.661366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839987-6-iscsi {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.661540 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.661690 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.661690 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.661690 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.661690 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.661690 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.661690 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.661690 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.661690 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.663073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.663073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.663073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.663073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.663073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.663073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.663073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.664197 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.664354 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.664583 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.664744 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.664901 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.665056 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.665211 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.665358 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.665358 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.665659 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.666422 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.666584 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.666744 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.666912 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.667060 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.667242 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.667399 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.667559 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.667715 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.667878 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.668791 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.668976 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.669135 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.669297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.669458 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.669458 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.669458 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.669891 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.670040 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.670205 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.670370 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.670518 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.670680 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.670850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.671006 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.671229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.671402 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.671559 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.671717 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.672456 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.672707 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.672871 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.673027 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.673185 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.673358 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.673517 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.673719 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.673879 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.673879 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.674175 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.674333 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.674483 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.674629 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.674832 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.674982 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.675162 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.675336 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.675494 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.675652 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.675800 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.675946 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.676107 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.676522 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.676689 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.676854 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.677003 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.677149 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.677311 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.677470 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.677639 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.677795 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.677953 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.678135 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.679286 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.679451 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.679612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.679768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.679923 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.679923 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.680226 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.680372 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.680538 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.680687 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.680832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.680997 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.681154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.681311 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.681465 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.681621 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.681776 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.681933 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.682089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.682248 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.682248 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.682558 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.682718 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.682866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.683027 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.683452 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.683616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.683764 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.683922 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.684070 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.684224 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.684378 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.684534 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.684694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.684868 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.685023 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.685181 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.685335 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.685494 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.685649 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.685807 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.685962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.686109 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.686262 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.686409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.686562 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.686723 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.686890 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.687048 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.687268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.687435 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.687584 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.687874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.688032 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.688198 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.688198 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.689243 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.689413 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.689572 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.689720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.689898 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.690056 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.690207 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.690354 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.690508 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.690655 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.690815 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.690965 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.691138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.691301 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.691301 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.691301 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.691301 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.691301 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.692031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.692186 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.692334 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.692488 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.692649 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.692797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.692957 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.693112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.693260 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.693420 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.693576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.693741 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.693741 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.694040 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.694040 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.694329 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.694475 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.694622 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.694781 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.694928 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.695082 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.695265 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.695423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.695571 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.695571 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.695881 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.696035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.696190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.696338 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.696493 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.696726 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.696883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.697078 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.697284 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.697284 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.697593 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.697757 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.697914 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.698062 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.698209 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.698357 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.698512 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.698966 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.699407 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.699578 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.699736 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.699910 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.700195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.700350 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.700518 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.700667 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.700822 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.700969 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.701130 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.701286 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.701434 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.701582 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.701728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.701885 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.702032 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.702179 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.702325 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.702482 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.702631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.702788 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.703157 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.703316 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 22:08:08.703464 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.703612 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.703771 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.703931 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.704089 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.704236 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.704383 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.704537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.704708 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.704876 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.705042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.705190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.705343 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.705491 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.705645 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.705802 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.705964 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.706120 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.706278 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.706431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.706590 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.706753 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.706909 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.707065 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.707250 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.707399 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.707546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.707701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.707857 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.708005 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.708160 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.708440 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.708603 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.709329 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.709478 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.709563 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.709649 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.709724 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.709804 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.709895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.709970 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.710049 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.710136 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.710247 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.710335 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.710335 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.710474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.710544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.710622 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.710700 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.710784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.710865 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.710944 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.711016 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.711094 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.711327 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.711416 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.711490 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.711568 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.711639 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.711720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.711799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.711881 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.711953 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.712031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.712102 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.712178 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.712262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.712335 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.712411 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.712483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.712553 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.713162 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.713256 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.713336 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.713430 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.713509 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.713581 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.713658 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.714912 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.715068 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.715227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.715326 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.715412 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.715503 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.715614 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.715701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.715785 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.715876 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.715967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.716065 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.716152 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.716244 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.716327 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.716418 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.716503 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.716594 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.716680 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.716771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.716862 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.716946 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.717035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.717035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.717035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.717035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.717347 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.717432 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.717515 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.717611 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.717706 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.717796 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.717880 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.717969 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.718062 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.718154 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.718238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.718328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.718411 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.718499 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.718597 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.718688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.718779 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.718869 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.718954 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.719033 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.719139 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.719228 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.719312 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.719423 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.719519 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.719610 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.719757 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.719844 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.719844 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.719985 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.720064 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.720141 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.720221 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.720293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.720363 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.720432 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.720502 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.720581 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.720665 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.720755 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.720840 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.720922 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721004 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721096 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721247 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721329 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721419 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721510 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721604 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721689 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721853 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.721936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.722332 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.722418 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.722514 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.722607 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.722692 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.722782 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.722866 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.722948 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.723038 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.723387 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.723501 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.723597 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.723688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.723781 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.723875 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.723961 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.724044 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.724134 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.724226 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.724311 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.724457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.724560 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.724653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.724737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.724821 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.724918 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.724918 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.725080 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.725171 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.725255 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.725339 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.725436 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.725569 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.725671 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.725879 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.725973 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.726185 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.726291 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.726491 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.726585 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.726794 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.726893 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.727207 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.727344 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.727487 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.727603 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.727801 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.727930 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.728139 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.728306 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.729120 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.729249 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.729450 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.729545 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.729768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.729900 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.730089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.730229 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.730406 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.730537 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.730722 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.730860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.731037 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.731215 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.731382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.731545 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.731707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.731875 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.732023 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.732195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.732347 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.732528 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.732660 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.732847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.732987 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.733171 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.733308 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.733490 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.733632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.733811 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.733942 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.734148 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.734252 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.734488 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.734622 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.734805 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.734961 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.735139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.735306 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.735473 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.735632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.735795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.736105 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.736206 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.736420 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.736521 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.736733 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.736825 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.737044 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.737135 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.737357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.737449 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.737670 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.737768 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.737984 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.738082 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.738294 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.738385 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.738603 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.738692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.738913 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.739004 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.739254 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.745365 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.745365 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.745552 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.745552 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.745707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.745707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.745886 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.745971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.746055 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.746055 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.746216 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.746301 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.746384 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.746475 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.746559 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.746650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.746750 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.746837 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.746921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.747011 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.747127 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.747231 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.747331 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.747424 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.747509 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.747593 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.747676 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.747767 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.747860 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.747952 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.748046 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.748131 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.748214 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.748305 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.748391 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.748481 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.748566 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.748657 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.748741 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.748906 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.748906 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.749077 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.749161 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.749257 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.749342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.749485 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.749627 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.749724 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.749817 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.749901 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.749992 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.750089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.750181 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.750275 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.750357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.750430 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.750570 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.750703 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.750799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.750893 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.750984 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.751076 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.751213 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.751307 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.751399 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.751484 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.751567 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.751658 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.751756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.751842 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.751932 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.752024 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.752114 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.752198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.752198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.752361 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.752444 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.752526 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.752615 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.752711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.752806 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.752891 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.752983 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.753074 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.753159 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.753159 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.753330 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.753416 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.753507 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.753635 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.753755 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.753863 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.753956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.754043 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.754135 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.754310 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.754404 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.754626 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.754770 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.754999 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.755126 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.755347 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.755440 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.755659 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.755752 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.755971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.756103 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.756281 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.756384 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.756591 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.756689 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.756897 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.756998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.757206 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.757329 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.757513 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.757618 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.757823 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.758107 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.758211 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.758436 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.758533 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.758751 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.758856 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.759057 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.759187 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.759425 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.760041 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.760272 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.760366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.760607 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.760746 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.760939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.761063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.761287 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.761391 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.761596 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.761710 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.761909 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.762024 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.762218 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.762369 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.762580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.762705 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.762925 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.763041 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.763257 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.763368 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.763578 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.763671 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.763886 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.763979 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.764196 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.764286 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.764503 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.764600 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.764841 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.764944 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.765104 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.765206 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.765416 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.765524 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.765732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.765831 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.766037 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.766130 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.766349 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.766455 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.766654 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.766754 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.766964 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.767070 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.767299 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.767406 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.767606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.767708 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.767910 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.768010 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.768213 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.768308 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.768524 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.768616 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.768832 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.768924 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.769139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.769240 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.769452 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.769587 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.769762 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.769863 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.770068 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.770169 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.770381 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.770481 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.770686 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.770826 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.770998 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.771096 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.774070 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.774218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.774310 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.774409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.774495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.774621 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.774714 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.774800 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.774900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.774996 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.775101 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.775246 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.775342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.775427 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.775512 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.775609 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.775696 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.775781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.775865 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.775950 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.775950 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.776112 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.776205 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.776290 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.776382 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.776473 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.776636 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.776725 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.776725 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.776893 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.776979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.777063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.777155 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.777240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.777332 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.777417 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.777500 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.777591 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.777685 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.777770 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.777853 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.777933 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.778013 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.778084 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.778180 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.778309 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.778450 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.778624 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.778738 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.778929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.779023 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.779262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.779358 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.779571 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.779676 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.779897 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.779992 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.780207 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.780346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.780513 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.780607 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.780814 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.780914 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.781119 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.781256 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.781419 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.781547 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.781724 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.781821 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.782036 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.782128 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.782410 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.782576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.782732 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.782835 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.783057 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.783184 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.783394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.783499 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.783699 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.783800 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.784006 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.784142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.784312 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.784413 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.784617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.784751 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.784921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.785015 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.785253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.785402 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.785557 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.785656 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.785857 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.785957 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.786161 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.786262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.786480 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.786579 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.786786 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.786883 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.787089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.787219 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.787416 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.787521 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.787720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.787820 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.788054 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.788153 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.788356 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.788513 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.788667 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.788765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.788979 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.789073 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.789292 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.789393 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.789604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.789707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.789915 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.790007 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.790226 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.790325 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.790540 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.790648 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.791409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.791506 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.791810 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.791989 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.792125 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.792314 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.792441 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.792640 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.792735 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.792959 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.793059 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.793271 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.793373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.793602 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.793703 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.793920 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.794024 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.794232 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.794326 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.794547 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.794639 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.794858 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.794964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.795193 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.795291 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.795502 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.795602 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.795816 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.795944 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.796126 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.796262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.796437 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.796579 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.796748 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.796889 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.797059 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.797205 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.797372 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.797520 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.797685 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.797840 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.797995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.798161 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.798306 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.798469 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.798618 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.798889 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.798988 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.799224 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.799331 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.799533 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.799641 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.799848 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.799990 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.800160 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.800259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.800464 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.800617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.800773 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.800873 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.801078 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.801180 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.801386 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.801517 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.801691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.801793 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.801997 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.802140 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.802322 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.802462 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.802634 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.802774 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.802956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.803079 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.803402 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.803498 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.803711 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.803804 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.804016 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.804107 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.804329 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.804484 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.804635 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.804730 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.805032 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.805136 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.805349 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.805449 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.805661 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.805753 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.805978 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.806085 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.806283 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.806424 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.807260 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.807369 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.807578 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.807685 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.807904 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.808005 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.808490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.808646 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.808766 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.808874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.809072 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.809166 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.809394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.809487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.809698 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.809792 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.810077 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.810176 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.810396 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.810530 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.810722 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.810842 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.811165 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.811262 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.811497 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.811638 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.811813 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.811914 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.812141 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.812234 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.812471 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.812573 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.812788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.812880 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.813101 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.813195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.813423 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.813737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.813854 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.814047 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.814149 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.814376 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.814526 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.814689 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.814783 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.815005 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.815163 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.815346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.815457 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.815660 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.815756 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.815968 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.816069 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.816273 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.816368 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.816600 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.816702 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.816907 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.817000 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.817232 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.817334 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.817548 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.817642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.817875 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.817968 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.818201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.818302 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.818509 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.818609 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.818836 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.818942 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.819166 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.819310 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.819477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.819621 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.819785 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.819935 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.820091 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.820244 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.820436 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.820552 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.820745 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.820901 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.821070 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.821172 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.821406 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.821500 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.821738 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.821845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.822084 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.822188 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.822392 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.822476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.822697 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.822780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.823021 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.823131 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.823403 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.823506 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.823732 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.823834 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.824041 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.824141 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.824350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.824443 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.824665 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.824761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.824972 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.825075 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.825278 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.825370 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.825585 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.825686 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.825899 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.825999 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.826206 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.826310 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.826507 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.826600 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.826811 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.826902 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.827153 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.827264 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.827464 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.827559 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.827789 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.827890 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.828102 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.828204 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.828410 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.828504 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.828716 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.828833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.829024 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.829143 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.829366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.829461 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.829672 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.829775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.830009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.830113 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.830318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.830417 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.830626 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.830726 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.830936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.831042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.831266 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.831379 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.831572 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.831673 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.831875 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.831976 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.832184 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.832277 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.832487 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.832581 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.832789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.832889 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.833089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.833189 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.833412 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.833514 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.833717 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.833817 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.834027 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.834128 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.834333 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.834433 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.834638 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.834740 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.834939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.835033 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.835263 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.835503 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.835610 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.835836 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.835930 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.836156 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.836249 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.836475 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.836577 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.836792 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.836884 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.837110 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.837213 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.837427 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.837528 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.837825 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.837932 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.838136 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.838244 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.838451 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.838552 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.838763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.838905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.839082 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.839240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.839422 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.839537 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.839738 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.839831 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.840053 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.840156 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.840363 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.840503 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.840678 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.840779 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.840993 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.841094 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.841308 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.841407 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.841664 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.841839 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.842032 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.842178 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.842325 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.842471 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.842628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.842782 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.842940 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.843081 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.843262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.843428 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.843592 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.843756 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.843906 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.844050 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.844188 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.844338 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.844488 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.844653 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.844813 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.844917 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.845005 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.845181 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.845313 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.845502 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.845630 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.845825 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.845956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.846161 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.846292 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.846478 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.846615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.846790 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.846931 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.847157 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.847271 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.847437 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.847578 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.847790 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.848102 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.848204 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.848406 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.848499 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.848718 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.848819 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.849031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.849155 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.849344 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.849447 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.849654 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.849748 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.849963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.850068 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.850275 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.850377 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.850585 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.850684 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.850890 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.850989 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.851219 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.851326 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.851530 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.851622 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.851836 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.851931 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.852153 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.852247 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.852473 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.852564 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.852782 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.852883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.853091 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.853182 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.853971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.854068 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.854337 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.854560 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.854810 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.854904 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.855138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.855257 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.855475 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.855575 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.855800 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.855896 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.856127 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.856233 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.856443 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.856536 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.856790 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.856910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.857097 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.857243 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.857410 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.857701 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.857799 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.858008 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.858119 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.858316 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.858410 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.858618 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.858711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.858926 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.859026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.859259 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.859429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.859562 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.859657 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.859867 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.859968 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.860175 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.860268 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.860480 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.860707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.860800 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.861054 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.861146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.861370 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.861470 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.861694 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.861798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.862009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.862102 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.862318 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.862411 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.862621 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.862726 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.862934 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.863026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.863251 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.863330 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.863556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.863663 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.863861 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.863960 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.864168 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.864260 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.864472 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.864576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.864772 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.864871 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.865079 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.865180 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.865383 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.865477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.865685 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.865817 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.865998 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.866092 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.866298 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.866393 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.866623 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.866723 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.866929 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.867022 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.867255 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.867351 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.867560 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.867654 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.867868 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.867969 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.868172 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.868274 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.868475 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.868567 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.868779 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.869460 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.869714 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.869937 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.870040 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.870283 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.870377 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.870613 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.870707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.870920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.871010 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.871258 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.871356 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.871566 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.871672 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.871876 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.872007 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.872197 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.872317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.872528 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.872651 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.872833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.872954 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.873138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.873269 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.873453 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.873582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.873763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.873892 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.874074 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.874202 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.874386 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.874513 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.874696 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.874818 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.875076 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.875238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.875356 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.875468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.875650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.875949 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.876078 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.876263 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.876384 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.876580 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.876701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.876916 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.877049 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.877242 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.877362 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.877549 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.877676 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.877859 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.877989 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.878169 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.878291 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.878540 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.878657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.878797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.878946 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.879101 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.879249 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.879440 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.879541 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.879751 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.879860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.880064 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.880165 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.880376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.880478 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.880683 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.880783 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.880991 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.881112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.881301 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.881439 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.881612 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.881739 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.881920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.882064 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.882248 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.882389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.882545 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.882697 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.883026 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.883368 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.883505 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.883698 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.883843 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.884016 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.884160 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.884350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.884506 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.885288 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.885443 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.885578 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.885738 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.885903 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.886055 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.886246 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.886384 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.886524 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.886663 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.886797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.887027 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.890780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.890927 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.891045 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.891262 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.891409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.891558 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.891692 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.891692 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.891951 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.892082 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.892220 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.892368 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.892500 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.892632 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.892770 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.892903 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.893048 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.893181 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.893321 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.893456 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.893594 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.893734 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.893876 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.894009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.894140 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.894822 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.894941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.895090 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.895257 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.895485 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.895628 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.895768 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.895908 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.896054 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.896225 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.896361 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.896502 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.896635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.896776 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.896909 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.897040 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.897178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.897322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.897462 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.897615 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.897748 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.897887 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.898009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.898120 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.898321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.898472 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.898618 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.898716 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.898803 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.898897 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.899062 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.899182 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.899282 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.899370 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.899455 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.899546 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.899643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.899730 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.899830 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.900113 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.900738 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.900883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.900991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.901131 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.901282 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.901395 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.901483 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.901575 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.901672 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.901766 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.901852 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.901943 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.902038 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.902138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.902213 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.902296 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.902381 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.902453 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.902536 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.902633 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.902720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.902804 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.902896 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.902989 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.903074 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.903197 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.903346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.903480 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.903569 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.903661 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.903755 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.903842 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.903926 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.903926 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.904087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.904179 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.904273 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.904368 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.904505 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.904648 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.904781 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.904879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.904978 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.905064 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.905135 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.905277 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.905367 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.905441 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.905548 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.905623 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.905695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.905782 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.905873 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.906036 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.906172 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.906370 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.906477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.906677 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.906777 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.907010 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.907148 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.907367 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.907463 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.907679 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.907780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.908009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.908101 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.908331 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.908456 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.908684 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.908886 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 22:08:08.909036 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.909383 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.909703 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.910038 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.910358 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.910671 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.910991 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.911330 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.913784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.913784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.913784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.913784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.913784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.913784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.913784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.914751 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.914751 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.914751 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.915063 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.915178 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.915425 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.915817 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.916197 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 22:08:08.916382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 22:08:08.932299 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_db.sqlalchemy.engines [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 22:08:08.940649 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_db.sqlalchemy.engines [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 22:08:08.996901 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.context [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8de9a745-abfa-4d62-8186-d36fd3c28976(cell1) {{(pid=117594) load_cells /opt/stack/nova/nova/context.py:464}} May 17 22:08:09.001308 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:08:09.002914 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:08:09.003749 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:08:09.005711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:08:09.006161 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.context [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8de9a745-abfa-4d62-8186-d36fd3c28976(cell1) {{(pid=117593) load_cells /opt/stack/nova/nova/context.py:464}} May 17 22:08:09.011458 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:08:09.013093 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:08:09.013916 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:08:09.015937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:08:09.017751 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_db.sqlalchemy.engines [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 22:08:09.020142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_db.sqlalchemy.engines [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 22:08:09.028833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_db.sqlalchemy.engines [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 22:08:09.030619 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_db.sqlalchemy.engines [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 22:08:09.183135 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_db.sqlalchemy.engines [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 22:08:09.193951 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_db.sqlalchemy.engines [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 22:08:09.502656 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: WARNING keystonemiddleware.auth_token [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 22:08:09.510832 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: WARNING keystonemiddleware.auth_token [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 22:08:09.530504 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: WARNING keystonemiddleware.auth_token [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 22:08:09.538286 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: WARNING keystonemiddleware.auth_token [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 22:08:09.860290 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: WARNING keystonemiddleware.auth_token [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 22:08:09.866505 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: WARNING keystonemiddleware.auth_token [None req-2b5c42c1-ff92-496a-8723-277cbdb7932d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 22:08:09.871986 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561a5cc769c0 pid: 117594 (default app) May 17 22:08:09.896839 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: WARNING keystonemiddleware.auth_token [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 22:08:09.904111 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: WARNING keystonemiddleware.auth_token [None req-59d980b1-b315-4864-a2b4-9c00fab894f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 22:08:09.909513 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561a5cc769c0 pid: 117593 (default app) May 17 22:08:58.567843 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1116143594", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "networks": [{"uuid": "8a62d14a-c66c-4e1f-821e-7071b2d3f6a0"}]}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:08:59.194101 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] validate_networks() for [('8a62d14a-c66c-4e1f-821e-7071b2d3f6a0', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:09:01.185744 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:09:01.186882 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:09:01.189800 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:09:01.189800 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:09:01.189800 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:09:01.213972 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:01.217978 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:01.218986 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:01.219647 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:01.299396 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Getting quotas for project 0d2df1e983894585869358afcafd0fb5. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:09:01.320974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Getting quotas for user 35ef7a36ac424aa995c44c9eb90bd1d6 and project 0d2df1e983894585869358afcafd0fb5. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:09:01.349534 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:09:01.363575 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:09:01.748557 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-79598533-937c-4d38-a325-dad900e835b5 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.133023 May 17 22:09:01.749477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 1/1] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:08:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:09:02.441501 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3926a900-b9d3-400f-a888-7387b00a50ff tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:02.446772 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3926a900-b9d3-400f-a888-7387b00a50ff tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:03.425526 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3926a900-b9d3-400f-a888-7387b00a50ff tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:03.452486 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3926a900-b9d3-400f-a888-7387b00a50ff tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1215 microversion: 2.1 time: 1.695305 May 17 22:09:03.455858 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 1/2] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:01 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1215 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:04.472769 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9c1aee48-7322-4e5f-90b3-c599ef8c1ced tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:04.473396 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9c1aee48-7322-4e5f-90b3-c599ef8c1ced tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:05.102754 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9c1aee48-7322-4e5f-90b3-c599ef8c1ced tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:05.125044 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9c1aee48-7322-4e5f-90b3-c599ef8c1ced tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1215 microversion: 2.1 time: 0.655882 May 17 22:09:05.139596 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 2/3] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:04 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1215 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:06.146834 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d99a4994-350e-4952-bd03-3fe473dbf35f tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:06.147585 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d99a4994-350e-4952-bd03-3fe473dbf35f tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:06.157364 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d99a4994-350e-4952-bd03-3fe473dbf35f tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:06.157983 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d99a4994-350e-4952-bd03-3fe473dbf35f tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:06.158908 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d99a4994-350e-4952-bd03-3fe473dbf35f tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:06.159525 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d99a4994-350e-4952-bd03-3fe473dbf35f tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:06.620227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d99a4994-350e-4952-bd03-3fe473dbf35f tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:06.651730 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d99a4994-350e-4952-bd03-3fe473dbf35f tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1211 microversion: 2.1 time: 0.509629 May 17 22:09:06.652529 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 2/4] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:06 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1211 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:07.672306 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-08d39e00-1bf5-42c8-acb6-dde4238097e9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:07.674602 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-08d39e00-1bf5-42c8-acb6-dde4238097e9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:07.686694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-08d39e00-1bf5-42c8-acb6-dde4238097e9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:07.687970 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-08d39e00-1bf5-42c8-acb6-dde4238097e9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:07.689007 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-08d39e00-1bf5-42c8-acb6-dde4238097e9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:07.689642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-08d39e00-1bf5-42c8-acb6-dde4238097e9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:07.963316 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-08d39e00-1bf5-42c8-acb6-dde4238097e9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:07.973009 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-08d39e00-1bf5-42c8-acb6-dde4238097e9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1275 microversion: 2.1 time: 0.305726 May 17 22:09:07.982834 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 3/5] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:07 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1275 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:08.453285 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7783c0f0-6e3f-4ed2-a2b8-084168cc316e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: .version_select at 0x7f09f3f77310>, body: {"keypair": {"name": "tempest-keypair-2140229721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwRLSNsxU/zs8IGFhvrN8BsZwK7cZcGgsRIeWG3hnoh7aDniiZ1t/eihprsag7QerCjgmKJCV5DZa/NTSgRi8kigq/wcqMxQ7Ir9zJm1yKTPM/tV2gdqjDsUdIFsbhrZQ=="}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:08.462565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-49453e24-b723-4683-8526-be1b8d563393 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Action: 'create', calling method: .version_select at 0x7f09f3f3d4c0>, body: {"keypair": {"name": "tempest-keypair-1143976754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXnF39LHbnYAnYc3dK8SgXFWpg1zzGICmwj8NXeoJUsBHKAvR/7gsHxpIs7vvH6Vxe2jORcfrY4UeUbTCNDhQRbrg261bWtUH8/o4IR/uevTZGaI4pfnVxyyUcX3HbwuQ=="}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:08.576455 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-49453e24-b723-4683-8526-be1b8d563393 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Getting quotas for project 422158a05bcb44c8917cf1a6408cd7ad. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:09:08.583800 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-7783c0f0-6e3f-4ed2-a2b8-084168cc316e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for project ea0809b61be446a69359b69b50b61710. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:09:08.598230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-49453e24-b723-4683-8526-be1b8d563393 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Getting quotas for user 532092f483874f05bc119211b9624492 and project 422158a05bcb44c8917cf1a6408cd7ad. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:09:08.608483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-7783c0f0-6e3f-4ed2-a2b8-084168cc316e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for user 4bbb6a0a08464e738ef0d062dfe87182 and project ea0809b61be446a69359b69b50b61710. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:09:08.803474 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-49453e24-b723-4683-8526-be1b8d563393 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.257749 May 17 22:09:08.807682 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 3/6] 10.222.0.24 () {62 vars in 1199 bytes} [Tue May 17 22:09:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1265 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 17 22:09:08.833517 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7783c0f0-6e3f-4ed2-a2b8-084168cc316e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.849397 May 17 22:09:08.834134 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 4/7] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 17 22:09:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:09.001247 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5777ca6f-4737-4eb5-8bbd-f56360ce0498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:09.002769 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5777ca6f-4737-4eb5-8bbd-f56360ce0498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:09.024182 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5777ca6f-4737-4eb5-8bbd-f56360ce0498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:09.029456 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5777ca6f-4737-4eb5-8bbd-f56360ce0498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:09.041833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5777ca6f-4737-4eb5-8bbd-f56360ce0498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:09.050237 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5777ca6f-4737-4eb5-8bbd-f56360ce0498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:09.729664 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5777ca6f-4737-4eb5-8bbd-f56360ce0498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:09.784185 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5777ca6f-4737-4eb5-8bbd-f56360ce0498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1273 microversion: 2.1 time: 0.776128 May 17 22:09:09.784857 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 4/8] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:08 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1273 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:10.807542 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6588365e-f9a7-48a2-aa03-174b74d64cc6 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:10.808850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6588365e-f9a7-48a2-aa03-174b74d64cc6 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:10.829239 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6588365e-f9a7-48a2-aa03-174b74d64cc6 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:10.838252 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6588365e-f9a7-48a2-aa03-174b74d64cc6 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:10.841144 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6588365e-f9a7-48a2-aa03-174b74d64cc6 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:10.842494 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6588365e-f9a7-48a2-aa03-174b74d64cc6 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:11.087607 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6588365e-f9a7-48a2-aa03-174b74d64cc6 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:11.106145 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6588365e-f9a7-48a2-aa03-174b74d64cc6 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1273 microversion: 2.1 time: 0.300786 May 17 22:09:11.106923 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 5/9] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:10 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1273 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:12.124154 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5a7a6b54-165c-44dc-ac09-29d2045e67a3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:12.124913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5a7a6b54-165c-44dc-ac09-29d2045e67a3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:12.143951 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5a7a6b54-165c-44dc-ac09-29d2045e67a3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:12.150003 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5a7a6b54-165c-44dc-ac09-29d2045e67a3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:12.150003 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5a7a6b54-165c-44dc-ac09-29d2045e67a3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:12.150003 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5a7a6b54-165c-44dc-ac09-29d2045e67a3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:13.090339 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5a7a6b54-165c-44dc-ac09-29d2045e67a3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:13.106409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5a7a6b54-165c-44dc-ac09-29d2045e67a3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.986316 May 17 22:09:13.107144 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 5/10] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:12 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:13.684659 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-53313aaa-68f7-4193-a888-b7451ed59ba1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Action: 'create', calling method: .version_select at 0x7f09f3ea7160>, body: {"keypair": {"name": "tempest-keypair-1617106322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjOpVuRqsSidpObtpyTFGPjFqNQdRyQXk4rYQshLYmWlRcvIMfU0OYoiRKXT1YSbHdC+smIuLgWG+NKFR6lQk2MrL0Z9qgkxgwiV3xmEMxcqsRcs6PWDJMa0aboCyAstQ=="}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:13.779763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-53313aaa-68f7-4193-a888-b7451ed59ba1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Getting quotas for project fe9b23322633464f975b94a2144fa300. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:09:13.798883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-53313aaa-68f7-4193-a888-b7451ed59ba1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Getting quotas for user 626cf3ce22fd4d019022b52e21916a2f and project fe9b23322633464f975b94a2144fa300. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:09:13.938666 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-53313aaa-68f7-4193-a888-b7451ed59ba1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.610479 May 17 22:09:13.945429 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 6/11] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 17 22:09:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:14.125568 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f6ea1134-097c-40b7-a41f-9173ecc73ffc tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:14.126860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f6ea1134-097c-40b7-a41f-9173ecc73ffc tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:14.166734 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f6ea1134-097c-40b7-a41f-9173ecc73ffc tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:14.167225 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f6ea1134-097c-40b7-a41f-9173ecc73ffc tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:14.168086 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f6ea1134-097c-40b7-a41f-9173ecc73ffc tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:14.168535 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f6ea1134-097c-40b7-a41f-9173ecc73ffc tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:14.513426 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f6ea1134-097c-40b7-a41f-9173ecc73ffc tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:14.543809 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f6ea1134-097c-40b7-a41f-9173ecc73ffc tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.422856 May 17 22:09:14.552440 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 6/12] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:14 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:15.566725 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-687d1e4d-dabf-407b-8395-ed22a34eb1e7 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:15.568203 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-687d1e4d-dabf-407b-8395-ed22a34eb1e7 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:15.589676 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-687d1e4d-dabf-407b-8395-ed22a34eb1e7 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:15.589676 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-687d1e4d-dabf-407b-8395-ed22a34eb1e7 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:15.589676 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-687d1e4d-dabf-407b-8395-ed22a34eb1e7 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:15.589676 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-687d1e4d-dabf-407b-8395-ed22a34eb1e7 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:16.551911 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-687d1e4d-dabf-407b-8395-ed22a34eb1e7 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:16.560582 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-687d1e4d-dabf-407b-8395-ed22a34eb1e7 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.998737 May 17 22:09:16.570025 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 7/13] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:15 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:17.130282 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-61a3f339-ae8a-46ec-b0ac-46b502f0f12f req-69257169-4c4a-47ac-8951-f4dec9e61d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ecc557-2ee5-4581-aace-b8de718753a6", "tag": "4122bc49-075f-46ee-9328-771d7f9793d0"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:17.160347 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-61a3f339-ae8a-46ec-b0ac-46b502f0f12f req-69257169-4c4a-47ac-8951-f4dec9e61d8a service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:17.160816 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-61a3f339-ae8a-46ec-b0ac-46b502f0f12f req-69257169-4c4a-47ac-8951-f4dec9e61d8a service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:17.213573 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-61a3f339-ae8a-46ec-b0ac-46b502f0f12f req-69257169-4c4a-47ac-8951-f4dec9e61d8a service nova] Creating event network-changed:4122bc49-075f-46ee-9328-771d7f9793d0 for instance 58ecc557-2ee5-4581-aace-b8de718753a6 on hv-cinder-83998 May 17 22:09:17.214136 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-61a3f339-ae8a-46ec-b0ac-46b502f0f12f req-69257169-4c4a-47ac-8951-f4dec9e61d8a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 22:09:17.220297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c76459cc-a072-474a-b2d9-509eec5c18a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:17.220842 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c76459cc-a072-474a-b2d9-509eec5c18a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:17.221735 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c76459cc-a072-474a-b2d9-509eec5c18a0 None None] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:17.222185 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c76459cc-a072-474a-b2d9-509eec5c18a0 None None] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:17.244955 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.compute.rpcapi [None req-c76459cc-a072-474a-b2d9-509eec5c18a0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 22:09:17.251051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c76459cc-a072-474a-b2d9-509eec5c18a0 None None] Releasing lock "compute-rpcapi-router" {{(pid=117594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 22:09:17.285655 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c76459cc-a072-474a-b2d9-509eec5c18a0 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369276 May 17 22:09:17.286908 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 7/14] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:17.590331 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fcd83932-0804-40ca-9735-e7a13630c6ec tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:17.592468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fcd83932-0804-40ca-9735-e7a13630c6ec tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:17.607183 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fcd83932-0804-40ca-9735-e7a13630c6ec tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:17.609862 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fcd83932-0804-40ca-9735-e7a13630c6ec tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:17.611491 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fcd83932-0804-40ca-9735-e7a13630c6ec tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:17.614485 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fcd83932-0804-40ca-9735-e7a13630c6ec tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:18.279922 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fcd83932-0804-40ca-9735-e7a13630c6ec tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:18.291722 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fcd83932-0804-40ca-9735-e7a13630c6ec tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.706274 May 17 22:09:18.303141 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 8/15] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:17 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:19.312170 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7ffb8c53-972e-4a12-92e6-4433bf52f1ce tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:19.314421 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7ffb8c53-972e-4a12-92e6-4433bf52f1ce tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:19.331482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7ffb8c53-972e-4a12-92e6-4433bf52f1ce tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:19.332328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7ffb8c53-972e-4a12-92e6-4433bf52f1ce tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:19.333411 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7ffb8c53-972e-4a12-92e6-4433bf52f1ce tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:19.334163 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7ffb8c53-972e-4a12-92e6-4433bf52f1ce tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:20.114226 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2103387433", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:20.187411 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7ffb8c53-972e-4a12-92e6-4433bf52f1ce tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:20.203970 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7ffb8c53-972e-4a12-92e6-4433bf52f1ce tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.896190 May 17 22:09:20.204963 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 8/16] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:19 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:20.294636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] validate_networks() for [('b394d145-5e4c-4ff3-9a9e-324cf4600d03', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:09:21.243828 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0dfa806d-95a8-4445-acce-3ce41570203d tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:21.246295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0dfa806d-95a8-4445-acce-3ce41570203d tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:21.266679 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0dfa806d-95a8-4445-acce-3ce41570203d tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:21.267592 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0dfa806d-95a8-4445-acce-3ce41570203d tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:21.270638 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0dfa806d-95a8-4445-acce-3ce41570203d tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:21.273767 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0dfa806d-95a8-4445-acce-3ce41570203d tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:21.871398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0dfa806d-95a8-4445-acce-3ce41570203d tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:21.879304 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0dfa806d-95a8-4445-acce-3ce41570203d tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.660305 May 17 22:09:21.879940 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 9/17] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:21 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:21.886678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1701509924", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a32e06d-55b9-408a-a0d4-94ee7082349b"}], "security_groups": [{"name": "tempest-securitygroup--1875484990"}], "key_name": "tempest-keypair-1143976754", "user_data": "}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:22.212705 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] validate_networks() for [('9a32e06d-55b9-408a-a0d4-94ee7082349b', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:09:22.661974 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:09:22.662511 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:09:22.662990 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:09:22.664168 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:09:22.664771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:09:22.679891 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:22.684046 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:22.705789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:22.706902 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:22.772829 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Getting quotas for project 7a0d6701b5d5441eb7eaf815d273d4d9. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:09:22.789170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Getting quotas for user 8cc69cd4250c436e8b893887604b2273 and project 7a0d6701b5d5441eb7eaf815d273d4d9. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:09:22.805396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:09:22.820901 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:09:23.040659 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1101beb1-3c6e-44fe-af67-f1411dabeaef tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.170619 May 17 22:09:23.047375 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 9/18] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:09:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 3178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 22:09:23.054822 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-24460727", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f877e2b-99bd-48e8-8b73-18e37441b914"}], "security_groups": [{"name": "tempest-securitygroup--68589261"}], "key_name": "tempest-keypair-2140229721", "user_data": "}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:23.375887 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] validate_networks() for [('6f877e2b-99bd-48e8-8b73-18e37441b914', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:09:23.950832 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:09:23.952168 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:09:23.953017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:09:23.954305 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:09:23.955007 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:09:23.974003 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:23.974847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:23.976139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:23.976907 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:24.082627 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Getting quotas for project 422158a05bcb44c8917cf1a6408cd7ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:09:24.095732 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Getting quotas for user 532092f483874f05bc119211b9624492 and project 422158a05bcb44c8917cf1a6408cd7ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:09:24.134999 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:09:24.137356 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:09:24.301728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eee279dc-1cfb-460b-b390-2cc58ea65b8b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.420652 May 17 22:09:24.305950 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 10/19] 10.222.0.24 () {62 vars in 1187 bytes} [Tue May 17 22:09:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 2425 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 17 22:09:24.310991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d9e9d4c8-2f16-44c9-bb2d-4f461ad0131c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:24.311618 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d9e9d4c8-2f16-44c9-bb2d-4f461ad0131c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:24.334119 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d9e9d4c8-2f16-44c9-bb2d-4f461ad0131c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:24.334911 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d9e9d4c8-2f16-44c9-bb2d-4f461ad0131c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:24.335916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d9e9d4c8-2f16-44c9-bb2d-4f461ad0131c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:24.336360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d9e9d4c8-2f16-44c9-bb2d-4f461ad0131c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:24.592012 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:09:24.593228 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:09:24.593868 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:09:24.594672 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:09:24.595382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:09:24.613924 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:24.617397 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:24.622185 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:24.623680 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:24.629128 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d9e9d4c8-2f16-44c9-bb2d-4f461ad0131c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:24.641035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d9e9d4c8-2f16-44c9-bb2d-4f461ad0131c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.330072 May 17 22:09:24.655680 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 11/20] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:24 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:24.655680 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-55e62bbd-9c99-4a1d-b554-c9d8b7a9620f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:24.655680 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-55e62bbd-9c99-4a1d-b554-c9d8b7a9620f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:24.696257 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for project ea0809b61be446a69359b69b50b61710. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:09:24.704829 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for user 4bbb6a0a08464e738ef0d062dfe87182 and project ea0809b61be446a69359b69b50b61710. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:09:24.765997 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:09:24.777471 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:09:25.070171 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d9faeb55-950a-4648-8c06-29c59b6c54c0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.020546 May 17 22:09:25.075347 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-55e62bbd-9c99-4a1d-b554-c9d8b7a9620f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:25.076923 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 10/21] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:09:23 2022] POST /compute/v2.1/servers => generated 400 bytes in 2028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:09:25.082052 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-02207b14-fce7-41ab-90a7-3236a5694222 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:25.083261 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-02207b14-fce7-41ab-90a7-3236a5694222 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:25.094591 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-55e62bbd-9c99-4a1d-b554-c9d8b7a9620f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1222 microversion: 2.1 time: 0.446750 May 17 22:09:25.097215 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 12/22] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:24 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1222 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:25.124565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2079542784", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4c55ac9-e586-497b-b788-2ee3d019ca2d"}], "security_groups": [{"name": "tempest-securitygroup--787513321"}], "key_name": "tempest-keypair-1617106322", "user_data": "}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:25.157237 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-02207b14-fce7-41ab-90a7-3236a5694222 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:25.170224 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-02207b14-fce7-41ab-90a7-3236a5694222 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:25.172475 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-02207b14-fce7-41ab-90a7-3236a5694222 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:25.173732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-02207b14-fce7-41ab-90a7-3236a5694222 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1282 microversion: 2.20 time: 0.095606 May 17 22:09:25.174789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 11/23] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:25 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:25.181153 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-43685d03-abce-4bec-8852-50c4ea9c9c78 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:25.182016 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-43685d03-abce-4bec-8852-50c4ea9c9c78 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:25.306132 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-43685d03-abce-4bec-8852-50c4ea9c9c78 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:25.343080 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-43685d03-abce-4bec-8852-50c4ea9c9c78 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1240 microversion: 2.1 time: 0.164273 May 17 22:09:25.344120 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 12/24] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:25 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1240 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:25.496914 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] validate_networks() for [('b4c55ac9-e586-497b-b788-2ee3d019ca2d', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:09:25.552690 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1639399712", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:25.666229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] validate_networks() for [('b394d145-5e4c-4ff3-9a9e-324cf4600d03', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:09:26.807444 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:09:26.809309 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:09:26.809704 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:09:26.810321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:09:26.811491 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:09:26.837932 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:26.838540 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:26.840152 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:26.840690 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:26.869441 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Getting quotas for project fe9b23322633464f975b94a2144fa300. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:09:26.871240 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:09:26.871694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:09:26.872150 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:09:26.872564 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:09:26.872981 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:09:26.875363 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Getting quotas for user 626cf3ce22fd4d019022b52e21916a2f and project fe9b23322633464f975b94a2144fa300. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:09:26.893103 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:26.898199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:09:26.906249 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:26.908056 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:26.908056 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:26.912288 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:09:26.965248 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Getting quotas for project 7a0d6701b5d5441eb7eaf815d273d4d9. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:09:26.970526 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Getting quotas for user 8cc69cd4250c436e8b893887604b2273 and project 7a0d6701b5d5441eb7eaf815d273d4d9. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:09:26.984549 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:09:26.987195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:09:27.094787 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bbb76902-5fa7-40b5-9c38-57e52936f898 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.996630 May 17 22:09:27.104577 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 13/25] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:09:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:09:27.111789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-15184bd8-2a72-496e-b8e1-72d3c3908c96 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.565147 May 17 22:09:27.113104 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9ebcfd8e-fe8b-49b1-9459-9c0e360b13ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:27.114167 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9ebcfd8e-fe8b-49b1-9459-9c0e360b13ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:27.115272 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 13/26] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:09:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:09:27.131008 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ebcfd8e-fe8b-49b1-9459-9c0e360b13ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:27.134624 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ebcfd8e-fe8b-49b1-9459-9c0e360b13ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:27.136043 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ebcfd8e-fe8b-49b1-9459-9c0e360b13ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:27.136492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ebcfd8e-fe8b-49b1-9459-9c0e360b13ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:27.142931 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0dbd54ff-18e6-490d-b4ec-6968b0df1155 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:27.149091 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0dbd54ff-18e6-490d-b4ec-6968b0df1155 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:27.162228 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0dbd54ff-18e6-490d-b4ec-6968b0df1155 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:27.163378 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0dbd54ff-18e6-490d-b4ec-6968b0df1155 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:27.164357 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0dbd54ff-18e6-490d-b4ec-6968b0df1155 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:27.164882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0dbd54ff-18e6-490d-b4ec-6968b0df1155 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:27.262683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0dbd54ff-18e6-490d-b4ec-6968b0df1155 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:27.279923 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0dbd54ff-18e6-490d-b4ec-6968b0df1155 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:27.281555 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0dbd54ff-18e6-490d-b4ec-6968b0df1155 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:27.282695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0dbd54ff-18e6-490d-b4ec-6968b0df1155 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1286 microversion: 2.20 time: 0.164380 May 17 22:09:27.287158 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 14/27] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:27 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1286 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:27.299601 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e5ac3a2e-643f-4042-8171-7aa668dca0fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:27.300229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e5ac3a2e-643f-4042-8171-7aa668dca0fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:27.310553 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e5ac3a2e-643f-4042-8171-7aa668dca0fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:27.310701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e5ac3a2e-643f-4042-8171-7aa668dca0fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:27.311851 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e5ac3a2e-643f-4042-8171-7aa668dca0fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:27.312474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e5ac3a2e-643f-4042-8171-7aa668dca0fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:27.423914 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9ebcfd8e-fe8b-49b1-9459-9c0e360b13ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:27.431538 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e5ac3a2e-643f-4042-8171-7aa668dca0fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:27.435436 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9ebcfd8e-fe8b-49b1-9459-9c0e360b13ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.329530 May 17 22:09:27.436009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 14/28] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:27 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:27.439900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e5ac3a2e-643f-4042-8171-7aa668dca0fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1244 microversion: 2.1 time: 0.149029 May 17 22:09:27.447794 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 15/29] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:27 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1244 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:27.447794 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c3a02648-8127-462e-a67f-e5ed39284861 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:27.447794 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c3a02648-8127-462e-a67f-e5ed39284861 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:27.451073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4e7b4833-a058-4c17-8180-7ba78d65423f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:27.452277 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4e7b4833-a058-4c17-8180-7ba78d65423f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:27.503201 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c3a02648-8127-462e-a67f-e5ed39284861 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:27.511516 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c3a02648-8127-462e-a67f-e5ed39284861 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1222 microversion: 2.1 time: 0.069401 May 17 22:09:27.512216 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 16/30] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:27 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:27.545501 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4e7b4833-a058-4c17-8180-7ba78d65423f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:27.552334 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4e7b4833-a058-4c17-8180-7ba78d65423f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1238 microversion: 2.1 time: 0.114903 May 17 22:09:27.552917 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 15/31] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:27 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1238 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:28.309857 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a7500fe1-3878-4038-aa2a-c913fc9ecdd9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:28.310673 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a7500fe1-3878-4038-aa2a-c913fc9ecdd9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:28.322900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a7500fe1-3878-4038-aa2a-c913fc9ecdd9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:28.324364 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a7500fe1-3878-4038-aa2a-c913fc9ecdd9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:28.328705 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a7500fe1-3878-4038-aa2a-c913fc9ecdd9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:28.328705 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a7500fe1-3878-4038-aa2a-c913fc9ecdd9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:28.420498 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a7500fe1-3878-4038-aa2a-c913fc9ecdd9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:28.431430 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a7500fe1-3878-4038-aa2a-c913fc9ecdd9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:28.433223 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a7500fe1-3878-4038-aa2a-c913fc9ecdd9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:28.434773 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a7500fe1-3878-4038-aa2a-c913fc9ecdd9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1278 microversion: 2.20 time: 0.130462 May 17 22:09:28.435539 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 17/32] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:28 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1278 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:28.458848 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d525f237-5150-44dd-bd96-725d88d67e93 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:28.459896 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d525f237-5150-44dd-bd96-725d88d67e93 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:28.461949 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-277a46ed-e283-4690-b5de-24183b453458 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:28.462737 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-277a46ed-e283-4690-b5de-24183b453458 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:28.466084 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d525f237-5150-44dd-bd96-725d88d67e93 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:28.466552 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d525f237-5150-44dd-bd96-725d88d67e93 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:28.467368 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d525f237-5150-44dd-bd96-725d88d67e93 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:28.468101 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d525f237-5150-44dd-bd96-725d88d67e93 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:28.469043 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-277a46ed-e283-4690-b5de-24183b453458 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:28.469567 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-277a46ed-e283-4690-b5de-24183b453458 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:28.470415 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-277a46ed-e283-4690-b5de-24183b453458 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:28.470929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-277a46ed-e283-4690-b5de-24183b453458 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:28.613431 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-277a46ed-e283-4690-b5de-24183b453458 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:28.622641 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-277a46ed-e283-4690-b5de-24183b453458 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1244 microversion: 2.1 time: 0.169083 May 17 22:09:28.623248 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 16/33] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:28 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1244 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:28.627881 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0a70a043-aef5-4f5d-b73d-aa375d782152 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:28.629046 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0a70a043-aef5-4f5d-b73d-aa375d782152 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:28.635401 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a70a043-aef5-4f5d-b73d-aa375d782152 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:28.635854 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a70a043-aef5-4f5d-b73d-aa375d782152 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:28.636916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a70a043-aef5-4f5d-b73d-aa375d782152 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:28.637363 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a70a043-aef5-4f5d-b73d-aa375d782152 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:28.720656 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0a70a043-aef5-4f5d-b73d-aa375d782152 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:28.728977 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0a70a043-aef5-4f5d-b73d-aa375d782152 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1226 microversion: 2.1 time: 0.104543 May 17 22:09:28.729557 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 17/34] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:28 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1226 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:28.740388 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-89f2bb9a-6954-4f7b-a325-2419b976cb20 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:28.742147 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-89f2bb9a-6954-4f7b-a325-2419b976cb20 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:28.749401 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89f2bb9a-6954-4f7b-a325-2419b976cb20 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:28.749986 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89f2bb9a-6954-4f7b-a325-2419b976cb20 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:28.750889 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89f2bb9a-6954-4f7b-a325-2419b976cb20 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:28.751384 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89f2bb9a-6954-4f7b-a325-2419b976cb20 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:28.803906 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d525f237-5150-44dd-bd96-725d88d67e93 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:28.818972 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d525f237-5150-44dd-bd96-725d88d67e93 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.364696 May 17 22:09:28.819881 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 18/35] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:28 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:28.903647 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-89f2bb9a-6954-4f7b-a325-2419b976cb20 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:28.920900 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-89f2bb9a-6954-4f7b-a325-2419b976cb20 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1242 microversion: 2.1 time: 0.187266 May 17 22:09:28.922082 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 18/36] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:28 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1242 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:29.463043 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-acb5051c-1a2d-4d80-9bcc-d29c2e9555fe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:29.466300 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-acb5051c-1a2d-4d80-9bcc-d29c2e9555fe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:29.475476 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-acb5051c-1a2d-4d80-9bcc-d29c2e9555fe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:29.476105 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-acb5051c-1a2d-4d80-9bcc-d29c2e9555fe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:29.480354 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-acb5051c-1a2d-4d80-9bcc-d29c2e9555fe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:29.481273 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-acb5051c-1a2d-4d80-9bcc-d29c2e9555fe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:29.572615 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-acb5051c-1a2d-4d80-9bcc-d29c2e9555fe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:29.581271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-acb5051c-1a2d-4d80-9bcc-d29c2e9555fe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:29.582812 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-acb5051c-1a2d-4d80-9bcc-d29c2e9555fe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:29.586838 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-acb5051c-1a2d-4d80-9bcc-d29c2e9555fe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1342 microversion: 2.20 time: 0.127954 May 17 22:09:29.591359 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 19/37] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:29 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1342 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:29.641228 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2c6d60c8-ff40-4b58-8bd1-0f822b6af6ae tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:29.641944 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2c6d60c8-ff40-4b58-8bd1-0f822b6af6ae tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:29.654625 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2c6d60c8-ff40-4b58-8bd1-0f822b6af6ae tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:29.656158 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2c6d60c8-ff40-4b58-8bd1-0f822b6af6ae tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:29.663154 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2c6d60c8-ff40-4b58-8bd1-0f822b6af6ae tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:29.663154 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2c6d60c8-ff40-4b58-8bd1-0f822b6af6ae tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:29.736578 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2c6d60c8-ff40-4b58-8bd1-0f822b6af6ae tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:29.746448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2c6d60c8-ff40-4b58-8bd1-0f822b6af6ae tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1292 microversion: 2.1 time: 0.110587 May 17 22:09:29.759604 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4bde5111-9003-413d-9acf-f210d4a8abc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:29.760709 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4bde5111-9003-413d-9acf-f210d4a8abc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:29.776077 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 19/38] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:29 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1292 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:29.776440 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4bde5111-9003-413d-9acf-f210d4a8abc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:29.777116 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4bde5111-9003-413d-9acf-f210d4a8abc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:29.779062 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4bde5111-9003-413d-9acf-f210d4a8abc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:29.781380 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4bde5111-9003-413d-9acf-f210d4a8abc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:29.838017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-84adfff3-3467-4df1-a4ec-e3568274f2c9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:29.838653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-84adfff3-3467-4df1-a4ec-e3568274f2c9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:29.857620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-84adfff3-3467-4df1-a4ec-e3568274f2c9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:29.858349 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-84adfff3-3467-4df1-a4ec-e3568274f2c9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:29.859236 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-84adfff3-3467-4df1-a4ec-e3568274f2c9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:29.859616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-84adfff3-3467-4df1-a4ec-e3568274f2c9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:30.063089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4bde5111-9003-413d-9acf-f210d4a8abc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:30.080987 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4bde5111-9003-413d-9acf-f210d4a8abc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1274 microversion: 2.1 time: 0.338682 May 17 22:09:30.081768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 20/39] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:29 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1274 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:30.091066 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0c8c223b-cef8-4f95-a67d-625e7b560069 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:30.097410 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0c8c223b-cef8-4f95-a67d-625e7b560069 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:30.112494 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c8c223b-cef8-4f95-a67d-625e7b560069 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:30.113280 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c8c223b-cef8-4f95-a67d-625e7b560069 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:30.114217 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c8c223b-cef8-4f95-a67d-625e7b560069 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:30.114811 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c8c223b-cef8-4f95-a67d-625e7b560069 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:30.268477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0c8c223b-cef8-4f95-a67d-625e7b560069 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:30.283505 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0c8c223b-cef8-4f95-a67d-625e7b560069 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1290 microversion: 2.1 time: 0.199815 May 17 22:09:30.284370 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 21/40] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:30 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1290 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:30.538812 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-84adfff3-3467-4df1-a4ec-e3568274f2c9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:30.548350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-84adfff3-3467-4df1-a4ec-e3568274f2c9 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.715448 May 17 22:09:30.563193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 20/41] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:29 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:30.607495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9065278a-cc12-4da1-afc8-25a432f17f76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:30.608195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9065278a-cc12-4da1-afc8-25a432f17f76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:30.616492 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9065278a-cc12-4da1-afc8-25a432f17f76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:30.616870 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9065278a-cc12-4da1-afc8-25a432f17f76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:30.619424 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9065278a-cc12-4da1-afc8-25a432f17f76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:30.620530 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9065278a-cc12-4da1-afc8-25a432f17f76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:30.766480 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ce9144a4-5a2f-4848-a87c-b6d340f0dfc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:30.767285 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ce9144a4-5a2f-4848-a87c-b6d340f0dfc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:30.780384 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ce9144a4-5a2f-4848-a87c-b6d340f0dfc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:30.781067 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ce9144a4-5a2f-4848-a87c-b6d340f0dfc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:30.782136 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ce9144a4-5a2f-4848-a87c-b6d340f0dfc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:30.782857 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ce9144a4-5a2f-4848-a87c-b6d340f0dfc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:30.869988 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9065278a-cc12-4da1-afc8-25a432f17f76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:30.869988 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9065278a-cc12-4da1-afc8-25a432f17f76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:30.871536 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9065278a-cc12-4da1-afc8-25a432f17f76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:30.871536 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9065278a-cc12-4da1-afc8-25a432f17f76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1340 microversion: 2.20 time: 0.241470 May 17 22:09:30.871536 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 22/42] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:30 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1340 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:31.108591 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0b74b539-9f79-4f32-9988-06efcea7e596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:31.109581 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0b74b539-9f79-4f32-9988-06efcea7e596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:31.118223 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0b74b539-9f79-4f32-9988-06efcea7e596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:31.119298 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0b74b539-9f79-4f32-9988-06efcea7e596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:31.122676 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0b74b539-9f79-4f32-9988-06efcea7e596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:31.128373 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ce9144a4-5a2f-4848-a87c-b6d340f0dfc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:31.136730 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0b74b539-9f79-4f32-9988-06efcea7e596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:31.140978 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ce9144a4-5a2f-4848-a87c-b6d340f0dfc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1310 microversion: 2.1 time: 0.378282 May 17 22:09:31.142421 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 21/43] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:30 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1310 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:31.251036 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0b74b539-9f79-4f32-9988-06efcea7e596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:31.259909 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0b74b539-9f79-4f32-9988-06efcea7e596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1292 microversion: 2.1 time: 0.157613 May 17 22:09:31.270416 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 23/44] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:31 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1292 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:31.301909 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-566ac207-9d13-410e-8441-22fa7bcbc6e8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:31.302644 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-566ac207-9d13-410e-8441-22fa7bcbc6e8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:31.309260 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-566ac207-9d13-410e-8441-22fa7bcbc6e8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:31.309798 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-566ac207-9d13-410e-8441-22fa7bcbc6e8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:31.310643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-566ac207-9d13-410e-8441-22fa7bcbc6e8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:31.311375 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-566ac207-9d13-410e-8441-22fa7bcbc6e8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:31.430621 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-566ac207-9d13-410e-8441-22fa7bcbc6e8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:31.438753 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-566ac207-9d13-410e-8441-22fa7bcbc6e8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1298 microversion: 2.1 time: 0.140818 May 17 22:09:31.439400 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 22/45] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:31 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1298 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:31.564684 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bc8ae95c-03d6-46c3-b84b-5ff5ceb1d561 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:31.565297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bc8ae95c-03d6-46c3-b84b-5ff5ceb1d561 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:31.572327 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bc8ae95c-03d6-46c3-b84b-5ff5ceb1d561 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:31.578899 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bc8ae95c-03d6-46c3-b84b-5ff5ceb1d561 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:31.578899 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bc8ae95c-03d6-46c3-b84b-5ff5ceb1d561 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:31.578899 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bc8ae95c-03d6-46c3-b84b-5ff5ceb1d561 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:31.832222 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bc8ae95c-03d6-46c3-b84b-5ff5ceb1d561 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:31.869658 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bc8ae95c-03d6-46c3-b84b-5ff5ceb1d561 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.297377 May 17 22:09:31.869658 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 24/46] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:31 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:31.889075 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e3c481fa-023d-490c-b3e4-8b0d21615d38 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:31.902174 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e3c481fa-023d-490c-b3e4-8b0d21615d38 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:31.909899 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3c481fa-023d-490c-b3e4-8b0d21615d38 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:31.910732 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3c481fa-023d-490c-b3e4-8b0d21615d38 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:31.912738 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3c481fa-023d-490c-b3e4-8b0d21615d38 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:31.913453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3c481fa-023d-490c-b3e4-8b0d21615d38 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:32.169217 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2baf3605-05e7-4c5b-b5f3-601eb37db00b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:32.172096 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2baf3605-05e7-4c5b-b5f3-601eb37db00b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:32.185373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2baf3605-05e7-4c5b-b5f3-601eb37db00b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:32.185373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2baf3605-05e7-4c5b-b5f3-601eb37db00b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:32.185373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2baf3605-05e7-4c5b-b5f3-601eb37db00b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:32.185373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2baf3605-05e7-4c5b-b5f3-601eb37db00b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:32.308417 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2baf3605-05e7-4c5b-b5f3-601eb37db00b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:32.310526 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e3c481fa-023d-490c-b3e4-8b0d21615d38 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:32.322243 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e3c481fa-023d-490c-b3e4-8b0d21615d38 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:32.326549 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e3c481fa-023d-490c-b3e4-8b0d21615d38 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:32.331018 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2baf3605-05e7-4c5b-b5f3-601eb37db00b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1298 microversion: 2.1 time: 0.173990 May 17 22:09:32.331422 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e3c481fa-023d-490c-b3e4-8b0d21615d38 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.472844 May 17 22:09:32.332033 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 23/47] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:31 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:32.341667 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 25/48] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:32 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:32.349392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dc4a81cf-cc88-4f5c-8279-d3e8bd28e335 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:32.349392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dc4a81cf-cc88-4f5c-8279-d3e8bd28e335 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:32.352080 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dc4a81cf-cc88-4f5c-8279-d3e8bd28e335 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:32.352708 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dc4a81cf-cc88-4f5c-8279-d3e8bd28e335 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:32.353642 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dc4a81cf-cc88-4f5c-8279-d3e8bd28e335 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:32.354088 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dc4a81cf-cc88-4f5c-8279-d3e8bd28e335 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:32.432141 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dc4a81cf-cc88-4f5c-8279-d3e8bd28e335 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:32.439916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dc4a81cf-cc88-4f5c-8279-d3e8bd28e335 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1280 microversion: 2.1 time: 0.106721 May 17 22:09:32.440486 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 24/49] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:32 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1280 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:32.458522 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-15e2f57e-f6bf-49ee-a573-50eda31432b0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:32.459527 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-15e2f57e-f6bf-49ee-a573-50eda31432b0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:32.466167 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15e2f57e-f6bf-49ee-a573-50eda31432b0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:32.466910 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15e2f57e-f6bf-49ee-a573-50eda31432b0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:32.467802 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15e2f57e-f6bf-49ee-a573-50eda31432b0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:32.468346 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15e2f57e-f6bf-49ee-a573-50eda31432b0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:32.538580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-15e2f57e-f6bf-49ee-a573-50eda31432b0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:32.545891 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-15e2f57e-f6bf-49ee-a573-50eda31432b0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1298 microversion: 2.1 time: 0.091340 May 17 22:09:32.546465 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 26/50] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:32 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:32.595006 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-03291488-0945-4a0c-87b3-9a9264e4402e req-544ca87b-ef6b-469b-b067-6d02ee7bebc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485c3cc1-ede2-4e51-ac41-c00abe07926e", "tag": "43990b62-6cdf-4ffd-9e88-4f471ea665e1"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:32.605201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-03291488-0945-4a0c-87b3-9a9264e4402e req-544ca87b-ef6b-469b-b067-6d02ee7bebc2 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:32.606359 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-03291488-0945-4a0c-87b3-9a9264e4402e req-544ca87b-ef6b-469b-b067-6d02ee7bebc2 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:32.632899 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-03291488-0945-4a0c-87b3-9a9264e4402e req-544ca87b-ef6b-469b-b067-6d02ee7bebc2 service nova] Creating event network-changed:43990b62-6cdf-4ffd-9e88-4f471ea665e1 for instance 485c3cc1-ede2-4e51-ac41-c00abe07926e on hv-cinder-83998 May 17 22:09:32.638182 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-03291488-0945-4a0c-87b3-9a9264e4402e req-544ca87b-ef6b-469b-b067-6d02ee7bebc2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048143 May 17 22:09:32.639265 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 25/51] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:32.877088 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1a98f25f-6927-49b5-931b-a211eb306e10 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:32.877779 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1a98f25f-6927-49b5-931b-a211eb306e10 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:32.884806 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a98f25f-6927-49b5-931b-a211eb306e10 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:32.885344 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a98f25f-6927-49b5-931b-a211eb306e10 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:32.886242 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a98f25f-6927-49b5-931b-a211eb306e10 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:32.886698 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a98f25f-6927-49b5-931b-a211eb306e10 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:33.040625 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1a98f25f-6927-49b5-931b-a211eb306e10 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:33.048844 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1a98f25f-6927-49b5-931b-a211eb306e10 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.176916 May 17 22:09:33.049414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 27/52] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:32 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:33.351718 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-76f429cf-d09a-469b-a77f-a202def80484 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:33.352674 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-76f429cf-d09a-469b-a77f-a202def80484 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:33.356263 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-30f76b7b-4e82-4570-bac6-9ac68266def1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:33.356863 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-30f76b7b-4e82-4570-bac6-9ac68266def1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:33.359999 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-76f429cf-d09a-469b-a77f-a202def80484 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:33.359999 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-76f429cf-d09a-469b-a77f-a202def80484 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:33.360245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-76f429cf-d09a-469b-a77f-a202def80484 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:33.360644 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-76f429cf-d09a-469b-a77f-a202def80484 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:33.363881 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-30f76b7b-4e82-4570-bac6-9ac68266def1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:33.364330 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-30f76b7b-4e82-4570-bac6-9ac68266def1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:33.365093 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-30f76b7b-4e82-4570-bac6-9ac68266def1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:33.366299 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-30f76b7b-4e82-4570-bac6-9ac68266def1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:33.452668 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-30f76b7b-4e82-4570-bac6-9ac68266def1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:33.468927 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-30f76b7b-4e82-4570-bac6-9ac68266def1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1298 microversion: 2.1 time: 0.116322 May 17 22:09:33.469559 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 28/53] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:33 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:33.474294 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a0e0797d-b933-4230-9bcd-0e3c474b3a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:33.475781 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a0e0797d-b933-4230-9bcd-0e3c474b3a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:33.485564 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0e0797d-b933-4230-9bcd-0e3c474b3a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:33.486271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0e0797d-b933-4230-9bcd-0e3c474b3a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:33.487286 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0e0797d-b933-4230-9bcd-0e3c474b3a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:33.487998 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0e0797d-b933-4230-9bcd-0e3c474b3a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:33.569768 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-76f429cf-d09a-469b-a77f-a202def80484 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:33.609825 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-76f429cf-d09a-469b-a77f-a202def80484 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:33.617484 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-76f429cf-d09a-469b-a77f-a202def80484 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:33.621058 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-76f429cf-d09a-469b-a77f-a202def80484 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.274553 May 17 22:09:33.622865 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 26/54] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:33 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:33.639747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a12e9364-57d5-4c40-8c3e-b173ac3f383a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:33.640238 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a12e9364-57d5-4c40-8c3e-b173ac3f383a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:33.651237 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a12e9364-57d5-4c40-8c3e-b173ac3f383a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:33.651694 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a12e9364-57d5-4c40-8c3e-b173ac3f383a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:33.652657 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a12e9364-57d5-4c40-8c3e-b173ac3f383a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:33.653121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a12e9364-57d5-4c40-8c3e-b173ac3f383a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:33.842823 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a12e9364-57d5-4c40-8c3e-b173ac3f383a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:33.875449 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a12e9364-57d5-4c40-8c3e-b173ac3f383a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1298 microversion: 2.1 time: 0.247337 May 17 22:09:33.878386 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 27/55] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:33 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1298 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:34.004653 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a0e0797d-b933-4230-9bcd-0e3c474b3a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:34.021207 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a0e0797d-b933-4230-9bcd-0e3c474b3a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.550456 May 17 22:09:34.035640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 29/56] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:33 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:34.067737 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-530d8b63-4a33-4e17-887f-29015f6ccbc8 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:34.072796 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-530d8b63-4a33-4e17-887f-29015f6ccbc8 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:34.077973 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-530d8b63-4a33-4e17-887f-29015f6ccbc8 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:34.078621 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-530d8b63-4a33-4e17-887f-29015f6ccbc8 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:34.082591 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-530d8b63-4a33-4e17-887f-29015f6ccbc8 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:34.083228 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-530d8b63-4a33-4e17-887f-29015f6ccbc8 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:34.393923 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-530d8b63-4a33-4e17-887f-29015f6ccbc8 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:34.401665 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-530d8b63-4a33-4e17-887f-29015f6ccbc8 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.337864 May 17 22:09:34.414739 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 28/57] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:34 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:34.488700 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-52104322-d367-4ec0-bb30-21562b91e1c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:34.489300 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-52104322-d367-4ec0-bb30-21562b91e1c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:34.496963 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-52104322-d367-4ec0-bb30-21562b91e1c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:34.497507 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-52104322-d367-4ec0-bb30-21562b91e1c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:34.498526 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-52104322-d367-4ec0-bb30-21562b91e1c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:34.499179 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-52104322-d367-4ec0-bb30-21562b91e1c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:34.540151 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-be9b5a79-1e46-42ba-8ee4-c573916283f5 req-964d7e2e-29c6-4b07-bb0c-1250d390c4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ecc557-2ee5-4581-aace-b8de718753a6", "name": "network-vif-plugged", "status": "completed", "tag": "4122bc49-075f-46ee-9328-771d7f9793d0"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:34.562937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-be9b5a79-1e46-42ba-8ee4-c573916283f5 req-964d7e2e-29c6-4b07-bb0c-1250d390c4a2 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:34.567413 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-be9b5a79-1e46-42ba-8ee4-c573916283f5 req-964d7e2e-29c6-4b07-bb0c-1250d390c4a2 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:34.606552 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-be9b5a79-1e46-42ba-8ee4-c573916283f5 req-964d7e2e-29c6-4b07-bb0c-1250d390c4a2 service nova] Creating event network-vif-plugged:4122bc49-075f-46ee-9328-771d7f9793d0 for instance 58ecc557-2ee5-4581-aace-b8de718753a6 on hv-cinder-83998 May 17 22:09:34.607569 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-be9b5a79-1e46-42ba-8ee4-c573916283f5 req-964d7e2e-29c6-4b07-bb0c-1250d390c4a2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 22:09:34.609376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-69c5701f-9317-4185-88fb-4b35c87e006a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:34.609991 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-69c5701f-9317-4185-88fb-4b35c87e006a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:34.610929 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-69c5701f-9317-4185-88fb-4b35c87e006a None None] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:34.611523 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-69c5701f-9317-4185-88fb-4b35c87e006a None None] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:34.632806 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-52104322-d367-4ec0-bb30-21562b91e1c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:34.639050 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.compute.rpcapi [None req-69c5701f-9317-4185-88fb-4b35c87e006a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 22:09:34.639990 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-69c5701f-9317-4185-88fb-4b35c87e006a None None] Releasing lock "compute-rpcapi-router" {{(pid=117593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 22:09:34.646572 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-52104322-d367-4ec0-bb30-21562b91e1c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1298 microversion: 2.1 time: 0.161382 May 17 22:09:34.649130 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 29/58] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:34 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1298 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:34.654128 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5e5a5147-8609-4116-88ee-0d140c88c2e5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:34.655787 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5e5a5147-8609-4116-88ee-0d140c88c2e5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:34.668970 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e5a5147-8609-4116-88ee-0d140c88c2e5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:34.670409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e5a5147-8609-4116-88ee-0d140c88c2e5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:34.671477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e5a5147-8609-4116-88ee-0d140c88c2e5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:34.672406 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e5a5147-8609-4116-88ee-0d140c88c2e5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:34.688492 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-69c5701f-9317-4185-88fb-4b35c87e006a None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250793 May 17 22:09:34.689280 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 30/59] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:34.932834 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fe9766cf-51d9-4725-99b2-5ba64b8e6dc9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:34.935352 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fe9766cf-51d9-4725-99b2-5ba64b8e6dc9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:34.968885 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5e5a5147-8609-4116-88ee-0d140c88c2e5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:34.986216 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fe9766cf-51d9-4725-99b2-5ba64b8e6dc9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:34.986743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fe9766cf-51d9-4725-99b2-5ba64b8e6dc9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:34.988618 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5e5a5147-8609-4116-88ee-0d140c88c2e5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:34.990006 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5e5a5147-8609-4116-88ee-0d140c88c2e5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:35.001851 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fe9766cf-51d9-4725-99b2-5ba64b8e6dc9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:35.002005 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5e5a5147-8609-4116-88ee-0d140c88c2e5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.341221 May 17 22:09:35.002098 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fe9766cf-51d9-4725-99b2-5ba64b8e6dc9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:35.004033 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 30/60] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:34 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:35.055926 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7a6efddb-cc54-46ea-b396-623ad2bd4c8d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:35.057129 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7a6efddb-cc54-46ea-b396-623ad2bd4c8d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:35.073613 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a6efddb-cc54-46ea-b396-623ad2bd4c8d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:35.074098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a6efddb-cc54-46ea-b396-623ad2bd4c8d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:35.074888 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a6efddb-cc54-46ea-b396-623ad2bd4c8d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:35.079761 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a6efddb-cc54-46ea-b396-623ad2bd4c8d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:35.456306 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7a6efddb-cc54-46ea-b396-623ad2bd4c8d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:35.470138 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7a6efddb-cc54-46ea-b396-623ad2bd4c8d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.421229 May 17 22:09:35.470937 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 31/61] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:35 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:35.476822 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e51c2add-2b3b-42ce-90ca-82afb365f215 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:35.477724 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e51c2add-2b3b-42ce-90ca-82afb365f215 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:35.484742 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e51c2add-2b3b-42ce-90ca-82afb365f215 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:35.487080 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e51c2add-2b3b-42ce-90ca-82afb365f215 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:35.488182 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e51c2add-2b3b-42ce-90ca-82afb365f215 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:35.488918 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e51c2add-2b3b-42ce-90ca-82afb365f215 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:35.556800 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fe9766cf-51d9-4725-99b2-5ba64b8e6dc9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:35.565294 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fe9766cf-51d9-4725-99b2-5ba64b8e6dc9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.670932 May 17 22:09:35.565900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 31/62] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:34 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:35.670882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9124731e-e5c6-44ae-9d30-b8f97089df45 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:35.671685 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9124731e-e5c6-44ae-9d30-b8f97089df45 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:35.685339 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9124731e-e5c6-44ae-9d30-b8f97089df45 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:35.686088 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9124731e-e5c6-44ae-9d30-b8f97089df45 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:35.687238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9124731e-e5c6-44ae-9d30-b8f97089df45 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:35.687830 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9124731e-e5c6-44ae-9d30-b8f97089df45 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:36.068043 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e51c2add-2b3b-42ce-90ca-82afb365f215 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:36.076147 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e51c2add-2b3b-42ce-90ca-82afb365f215 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.603904 May 17 22:09:36.077334 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 32/63] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:35 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:36.087056 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9124731e-e5c6-44ae-9d30-b8f97089df45 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:36.092168 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9124731e-e5c6-44ae-9d30-b8f97089df45 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.426176 May 17 22:09:36.092983 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 32/64] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:35 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:36.097839 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-81bc9a2b-8a5a-4faa-919e-355899b1854b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:36.098802 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-81bc9a2b-8a5a-4faa-919e-355899b1854b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:36.107502 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81bc9a2b-8a5a-4faa-919e-355899b1854b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:36.108186 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81bc9a2b-8a5a-4faa-919e-355899b1854b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:36.109263 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81bc9a2b-8a5a-4faa-919e-355899b1854b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:36.109852 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81bc9a2b-8a5a-4faa-919e-355899b1854b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:36.243656 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-1a110f94-8116-4ce4-b117-d21ea6e2f835 req-4c190b5d-808e-4bbf-8573-e98a48cbeabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c568a7b-6b45-45c4-b60a-3514d7c43e6e", "tag": "501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:36.261359 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-1a110f94-8116-4ce4-b117-d21ea6e2f835 req-4c190b5d-808e-4bbf-8573-e98a48cbeabb service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:36.262073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-1a110f94-8116-4ce4-b117-d21ea6e2f835 req-4c190b5d-808e-4bbf-8573-e98a48cbeabb service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:36.275337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-1a110f94-8116-4ce4-b117-d21ea6e2f835 req-4c190b5d-808e-4bbf-8573-e98a48cbeabb service nova] Creating event network-changed:501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e for instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e on hv-cinder-83998 May 17 22:09:36.281335 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-1a110f94-8116-4ce4-b117-d21ea6e2f835 req-4c190b5d-808e-4bbf-8573-e98a48cbeabb service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192779 May 17 22:09:36.282696 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 33/65] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:36.290746 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-2cab75e0-b40d-4558-bace-74e33a9ab826 req-2f1c8599-ab1e-4f91-8620-5561d1b70f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f605a2f-287e-4adb-8178-2e2a76f6303f", "tag": "2f43fb3e-b8f4-499d-888d-e9a598121d47"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:36.301783 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-2cab75e0-b40d-4558-bace-74e33a9ab826 req-2f1c8599-ab1e-4f91-8620-5561d1b70f50 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:36.302450 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-2cab75e0-b40d-4558-bace-74e33a9ab826 req-2f1c8599-ab1e-4f91-8620-5561d1b70f50 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:36.318517 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-2cab75e0-b40d-4558-bace-74e33a9ab826 req-2f1c8599-ab1e-4f91-8620-5561d1b70f50 service nova] Creating event network-changed:2f43fb3e-b8f4-499d-888d-e9a598121d47 for instance 0f605a2f-287e-4adb-8178-2e2a76f6303f on hv-cinder-83998 May 17 22:09:36.324171 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-2cab75e0-b40d-4558-bace-74e33a9ab826 req-2f1c8599-ab1e-4f91-8620-5561d1b70f50 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039950 May 17 22:09:36.325295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 34/66] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:36.375065 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-81bc9a2b-8a5a-4faa-919e-355899b1854b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:36.385178 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-81bc9a2b-8a5a-4faa-919e-355899b1854b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:36.386714 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-81bc9a2b-8a5a-4faa-919e-355899b1854b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:36.387871 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-81bc9a2b-8a5a-4faa-919e-355899b1854b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.293730 May 17 22:09:36.388442 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 33/67] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:36 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:36.489537 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ae142c9a-769a-4673-bec0-0d8fed865b8f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:36.491810 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ae142c9a-769a-4673-bec0-0d8fed865b8f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:36.499709 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae142c9a-769a-4673-bec0-0d8fed865b8f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:36.500493 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae142c9a-769a-4673-bec0-0d8fed865b8f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:36.501681 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae142c9a-769a-4673-bec0-0d8fed865b8f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:36.502333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae142c9a-769a-4673-bec0-0d8fed865b8f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:36.582756 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f7efb9c7-3546-4608-ac47-c98dc001dd0c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:36.585100 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f7efb9c7-3546-4608-ac47-c98dc001dd0c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:36.591693 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f7efb9c7-3546-4608-ac47-c98dc001dd0c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:36.592901 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f7efb9c7-3546-4608-ac47-c98dc001dd0c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:36.593693 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f7efb9c7-3546-4608-ac47-c98dc001dd0c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:36.594138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f7efb9c7-3546-4608-ac47-c98dc001dd0c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:37.258115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f7efb9c7-3546-4608-ac47-c98dc001dd0c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:37.277963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f7efb9c7-3546-4608-ac47-c98dc001dd0c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.699201 May 17 22:09:37.279204 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 34/68] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:36 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:37.286587 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a5f5b984-0497-4a44-8a1b-9778d9330d74 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:37.287713 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a5f5b984-0497-4a44-8a1b-9778d9330d74 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:37.307926 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5f5b984-0497-4a44-8a1b-9778d9330d74 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:37.309108 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5f5b984-0497-4a44-8a1b-9778d9330d74 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:37.310228 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5f5b984-0497-4a44-8a1b-9778d9330d74 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:37.310895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5f5b984-0497-4a44-8a1b-9778d9330d74 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:37.338167 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ae142c9a-769a-4673-bec0-0d8fed865b8f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:37.345587 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ae142c9a-769a-4673-bec0-0d8fed865b8f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.861987 May 17 22:09:37.363512 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 35/69] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:36 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:37.368902 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d9c9041f-aaa9-4855-be31-138943f7e896 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:37.369527 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d9c9041f-aaa9-4855-be31-138943f7e896 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:37.383004 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d9c9041f-aaa9-4855-be31-138943f7e896 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:37.383687 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d9c9041f-aaa9-4855-be31-138943f7e896 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:37.384827 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d9c9041f-aaa9-4855-be31-138943f7e896 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:37.385513 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d9c9041f-aaa9-4855-be31-138943f7e896 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:38.205508 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a5f5b984-0497-4a44-8a1b-9778d9330d74 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:38.219522 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a5f5b984-0497-4a44-8a1b-9778d9330d74 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.938792 May 17 22:09:38.227049 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 35/70] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:37 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:38.241842 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-55089e5b-c53a-4076-ae85-9d3fd17b230a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:38.242615 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-55089e5b-c53a-4076-ae85-9d3fd17b230a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:38.248803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55089e5b-c53a-4076-ae85-9d3fd17b230a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:38.249401 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55089e5b-c53a-4076-ae85-9d3fd17b230a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:38.250281 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55089e5b-c53a-4076-ae85-9d3fd17b230a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:38.250814 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55089e5b-c53a-4076-ae85-9d3fd17b230a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:38.268355 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d9c9041f-aaa9-4855-be31-138943f7e896 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:38.278371 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d9c9041f-aaa9-4855-be31-138943f7e896 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.913689 May 17 22:09:38.278963 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 36/71] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:37 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:38.296527 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-571f7c0d-4464-469e-a701-b42d42ad11b9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:38.297389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-571f7c0d-4464-469e-a701-b42d42ad11b9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:38.305560 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-571f7c0d-4464-469e-a701-b42d42ad11b9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:38.306175 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-571f7c0d-4464-469e-a701-b42d42ad11b9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:38.307241 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-571f7c0d-4464-469e-a701-b42d42ad11b9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:38.308036 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-571f7c0d-4464-469e-a701-b42d42ad11b9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:38.671509 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-55089e5b-c53a-4076-ae85-9d3fd17b230a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:38.687068 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-55089e5b-c53a-4076-ae85-9d3fd17b230a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:38.689100 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-55089e5b-c53a-4076-ae85-9d3fd17b230a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:38.690281 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-55089e5b-c53a-4076-ae85-9d3fd17b230a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.463465 May 17 22:09:38.690999 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 36/72] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:38 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:38.698545 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bd47d49f-2bb0-4187-969d-5ee673aa005d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:38.699370 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bd47d49f-2bb0-4187-969d-5ee673aa005d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:38.707369 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-571f7c0d-4464-469e-a701-b42d42ad11b9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:38.707589 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd47d49f-2bb0-4187-969d-5ee673aa005d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:38.708161 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd47d49f-2bb0-4187-969d-5ee673aa005d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:38.709639 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd47d49f-2bb0-4187-969d-5ee673aa005d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:38.710391 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd47d49f-2bb0-4187-969d-5ee673aa005d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:38.715607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-571f7c0d-4464-469e-a701-b42d42ad11b9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.423335 May 17 22:09:38.716184 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 37/73] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:38 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:38.721667 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-61e612f0-e105-4c81-a125-44a156dc3986 req-f250c20b-ec94-4711-a48f-a2a853922a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e6e64e-c18e-4856-9a95-0833c10482ee", "tag": "de95285b-0a74-427f-90f8-1b48b78cd597"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:38.730515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-61e612f0-e105-4c81-a125-44a156dc3986 req-f250c20b-ec94-4711-a48f-a2a853922a93 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:38.730953 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-61e612f0-e105-4c81-a125-44a156dc3986 req-f250c20b-ec94-4711-a48f-a2a853922a93 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:38.744787 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-61e612f0-e105-4c81-a125-44a156dc3986 req-f250c20b-ec94-4711-a48f-a2a853922a93 service nova] Creating event network-changed:de95285b-0a74-427f-90f8-1b48b78cd597 for instance 65e6e64e-c18e-4856-9a95-0833c10482ee on hv-cinder-83998 May 17 22:09:38.753829 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-61e612f0-e105-4c81-a125-44a156dc3986 req-f250c20b-ec94-4711-a48f-a2a853922a93 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035395 May 17 22:09:38.754441 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 38/74] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:39.149030 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bd47d49f-2bb0-4187-969d-5ee673aa005d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:39.187542 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bd47d49f-2bb0-4187-969d-5ee673aa005d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.494269 May 17 22:09:39.193598 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 37/75] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:38 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:39.246953 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-25929db2-e3bc-4a68-9d2a-5777273fffd1 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:39.248594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-25929db2-e3bc-4a68-9d2a-5777273fffd1 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:39.275272 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-25929db2-e3bc-4a68-9d2a-5777273fffd1 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:39.276337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-25929db2-e3bc-4a68-9d2a-5777273fffd1 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:39.279335 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-25929db2-e3bc-4a68-9d2a-5777273fffd1 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:39.280449 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-25929db2-e3bc-4a68-9d2a-5777273fffd1 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:39.296438 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-96ce4462-5a9d-4988-92b9-3fd6f9f3083c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:39.297581 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-96ce4462-5a9d-4988-92b9-3fd6f9f3083c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:39.312121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-96ce4462-5a9d-4988-92b9-3fd6f9f3083c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:39.312755 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-96ce4462-5a9d-4988-92b9-3fd6f9f3083c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:39.313783 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-96ce4462-5a9d-4988-92b9-3fd6f9f3083c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:39.314351 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-96ce4462-5a9d-4988-92b9-3fd6f9f3083c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:39.564857 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-25929db2-e3bc-4a68-9d2a-5777273fffd1 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:39.568031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-96ce4462-5a9d-4988-92b9-3fd6f9f3083c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:39.574460 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-25929db2-e3bc-4a68-9d2a-5777273fffd1 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1315 microversion: 2.1 time: 0.336383 May 17 22:09:39.577919 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-96ce4462-5a9d-4988-92b9-3fd6f9f3083c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.286555 May 17 22:09:39.579250 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 38/76] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:39 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:39.586202 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 39/77] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:39 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:39.617680 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-d8cab546-d392-4c76-8aae-eb0129abf95f req-f3e8d932-a8fe-4102-8b37-ddab2cb20ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120f12ef-0f38-41f4-a47d-2fdb6ffe8831", "tag": "6bf3020e-df21-491a-8ec0-6c8d0f806985"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:39.649554 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-d8cab546-d392-4c76-8aae-eb0129abf95f req-f3e8d932-a8fe-4102-8b37-ddab2cb20ebf service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:39.650003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-d8cab546-d392-4c76-8aae-eb0129abf95f req-f3e8d932-a8fe-4102-8b37-ddab2cb20ebf service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:39.661670 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-d8cab546-d392-4c76-8aae-eb0129abf95f req-f3e8d932-a8fe-4102-8b37-ddab2cb20ebf service nova] Creating event network-changed:6bf3020e-df21-491a-8ec0-6c8d0f806985 for instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 on hv-cinder-83998 May 17 22:09:39.671231 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-d8cab546-d392-4c76-8aae-eb0129abf95f req-f3e8d932-a8fe-4102-8b37-ddab2cb20ebf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057357 May 17 22:09:39.675059 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 39/78] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:39.713047 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bf712c76-c55f-4677-aff0-a137eee6ddea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:39.713658 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bf712c76-c55f-4677-aff0-a137eee6ddea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:39.720331 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf712c76-c55f-4677-aff0-a137eee6ddea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:39.720780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf712c76-c55f-4677-aff0-a137eee6ddea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:39.721594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf712c76-c55f-4677-aff0-a137eee6ddea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:39.722032 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf712c76-c55f-4677-aff0-a137eee6ddea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:39.735357 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3226d93d-4222-4545-bc77-a88644ada843 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:39.736737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3226d93d-4222-4545-bc77-a88644ada843 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:39.745624 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3226d93d-4222-4545-bc77-a88644ada843 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:39.746578 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3226d93d-4222-4545-bc77-a88644ada843 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:39.747560 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3226d93d-4222-4545-bc77-a88644ada843 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:39.748129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3226d93d-4222-4545-bc77-a88644ada843 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:39.942779 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bf712c76-c55f-4677-aff0-a137eee6ddea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:39.947210 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3226d93d-4222-4545-bc77-a88644ada843 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:39.955099 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bf712c76-c55f-4677-aff0-a137eee6ddea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:39.955971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3226d93d-4222-4545-bc77-a88644ada843 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.225539 May 17 22:09:39.963275 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 40/79] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:39 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:39.963397 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bf712c76-c55f-4677-aff0-a137eee6ddea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:39.963397 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bf712c76-c55f-4677-aff0-a137eee6ddea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.252242 May 17 22:09:39.963397 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 40/80] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:39 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:40.205816 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6053b96a-2c1a-4f20-8dab-112ebd9e44b8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:40.206428 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6053b96a-2c1a-4f20-8dab-112ebd9e44b8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:40.213451 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6053b96a-2c1a-4f20-8dab-112ebd9e44b8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:40.213898 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6053b96a-2c1a-4f20-8dab-112ebd9e44b8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:40.214692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6053b96a-2c1a-4f20-8dab-112ebd9e44b8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:40.215264 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6053b96a-2c1a-4f20-8dab-112ebd9e44b8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:40.513291 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6053b96a-2c1a-4f20-8dab-112ebd9e44b8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:40.520693 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6053b96a-2c1a-4f20-8dab-112ebd9e44b8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.318733 May 17 22:09:40.523146 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 41/81] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:40 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:40.593150 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d4ee2557-5a91-4bec-bfa9-73f3893e81ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:40.593893 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d4ee2557-5a91-4bec-bfa9-73f3893e81ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:40.597565 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b6aec09b-2ae5-483a-b77c-e4d3c0ce6d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:40.598176 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b6aec09b-2ae5-483a-b77c-e4d3c0ce6d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:40.604002 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d4ee2557-5a91-4bec-bfa9-73f3893e81ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:40.604476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d4ee2557-5a91-4bec-bfa9-73f3893e81ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:40.604855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6aec09b-2ae5-483a-b77c-e4d3c0ce6d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:40.605310 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6aec09b-2ae5-483a-b77c-e4d3c0ce6d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:40.605431 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d4ee2557-5a91-4bec-bfa9-73f3893e81ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:40.605822 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d4ee2557-5a91-4bec-bfa9-73f3893e81ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:40.606088 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6aec09b-2ae5-483a-b77c-e4d3c0ce6d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:40.606535 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6aec09b-2ae5-483a-b77c-e4d3c0ce6d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:40.822647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b6aec09b-2ae5-483a-b77c-e4d3c0ce6d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:40.827949 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d4ee2557-5a91-4bec-bfa9-73f3893e81ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:40.842201 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b6aec09b-2ae5-483a-b77c-e4d3c0ce6d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.247684 May 17 22:09:40.842572 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d4ee2557-5a91-4bec-bfa9-73f3893e81ee tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1501 microversion: 2.1 time: 0.253100 May 17 22:09:40.843194 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 41/82] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:40 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1501 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:40.843934 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 42/83] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:40 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:40.980325 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2b9dd795-a273-4616-b9ba-34ea3083b3f2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:40.980325 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2b9dd795-a273-4616-b9ba-34ea3083b3f2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:40.983191 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b83d976c-bf5c-4dbd-8bb2-66d0540ffe14 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:40.984029 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b83d976c-bf5c-4dbd-8bb2-66d0540ffe14 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:40.984955 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b9dd795-a273-4616-b9ba-34ea3083b3f2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:40.985895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b9dd795-a273-4616-b9ba-34ea3083b3f2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:40.986749 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b9dd795-a273-4616-b9ba-34ea3083b3f2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:40.987321 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b9dd795-a273-4616-b9ba-34ea3083b3f2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:40.994893 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b83d976c-bf5c-4dbd-8bb2-66d0540ffe14 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:40.995588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b83d976c-bf5c-4dbd-8bb2-66d0540ffe14 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:40.996685 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b83d976c-bf5c-4dbd-8bb2-66d0540ffe14 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:40.998071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b83d976c-bf5c-4dbd-8bb2-66d0540ffe14 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:41.209176 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2b9dd795-a273-4616-b9ba-34ea3083b3f2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:41.216579 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2b9dd795-a273-4616-b9ba-34ea3083b3f2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.246168 May 17 22:09:41.217246 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 43/84] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:40 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:41.239842 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b83d976c-bf5c-4dbd-8bb2-66d0540ffe14 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:41.248235 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b83d976c-bf5c-4dbd-8bb2-66d0540ffe14 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:41.249733 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b83d976c-bf5c-4dbd-8bb2-66d0540ffe14 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:41.250847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b83d976c-bf5c-4dbd-8bb2-66d0540ffe14 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.274316 May 17 22:09:41.251444 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 42/85] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:40 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:41.537751 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1b35a08a-ff49-4fd7-809e-00aff15988bf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:41.538358 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1b35a08a-ff49-4fd7-809e-00aff15988bf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:41.559893 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b35a08a-ff49-4fd7-809e-00aff15988bf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:41.560353 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b35a08a-ff49-4fd7-809e-00aff15988bf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:41.561148 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b35a08a-ff49-4fd7-809e-00aff15988bf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:41.561796 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b35a08a-ff49-4fd7-809e-00aff15988bf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:41.715500 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1b35a08a-ff49-4fd7-809e-00aff15988bf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:41.722781 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1b35a08a-ff49-4fd7-809e-00aff15988bf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.188851 May 17 22:09:41.723371 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 44/86] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:41 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:41.862562 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a7f7f689-ff73-4506-bcd8-7ea48295689f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:41.862562 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a7f7f689-ff73-4506-bcd8-7ea48295689f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:41.868026 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7f7f689-ff73-4506-bcd8-7ea48295689f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:41.868466 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7f7f689-ff73-4506-bcd8-7ea48295689f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:41.869237 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7f7f689-ff73-4506-bcd8-7ea48295689f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:41.870078 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7f7f689-ff73-4506-bcd8-7ea48295689f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:42.005705 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a7f7f689-ff73-4506-bcd8-7ea48295689f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:42.013606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a7f7f689-ff73-4506-bcd8-7ea48295689f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.156751 May 17 22:09:42.014178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 43/87] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:41 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:42.233707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a6dfe753-b309-4a9e-86fb-0dd21c2479f5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:42.234317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a6dfe753-b309-4a9e-86fb-0dd21c2479f5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:42.240463 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a6dfe753-b309-4a9e-86fb-0dd21c2479f5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:42.241022 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a6dfe753-b309-4a9e-86fb-0dd21c2479f5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:42.241795 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a6dfe753-b309-4a9e-86fb-0dd21c2479f5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:42.242502 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a6dfe753-b309-4a9e-86fb-0dd21c2479f5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:42.270553 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f52ff1f0-07a8-4880-8688-2c9ef6651df1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:42.271817 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f52ff1f0-07a8-4880-8688-2c9ef6651df1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:42.278746 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f52ff1f0-07a8-4880-8688-2c9ef6651df1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:42.279356 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f52ff1f0-07a8-4880-8688-2c9ef6651df1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:42.281800 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f52ff1f0-07a8-4880-8688-2c9ef6651df1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:42.282200 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f52ff1f0-07a8-4880-8688-2c9ef6651df1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:42.435995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a6dfe753-b309-4a9e-86fb-0dd21c2479f5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:42.443850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a6dfe753-b309-4a9e-86fb-0dd21c2479f5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.213958 May 17 22:09:42.444770 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 45/88] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:42 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:42.463068 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f52ff1f0-07a8-4880-8688-2c9ef6651df1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:42.471249 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f52ff1f0-07a8-4880-8688-2c9ef6651df1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:42.472767 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f52ff1f0-07a8-4880-8688-2c9ef6651df1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:42.473863 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f52ff1f0-07a8-4880-8688-2c9ef6651df1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.207338 May 17 22:09:42.475271 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 44/89] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:42 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:42.666511 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3ce9cab0-4381-4d01-83a7-5d5c16ade343 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d1b6e7c-5d7a-482d-ba3f-0aa10a7243a5"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:42.667699 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3ce9cab0-4381-4d01-83a7-5d5c16ade343 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:42.673555 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3ce9cab0-4381-4d01-83a7-5d5c16ade343 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:42.674009 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3ce9cab0-4381-4d01-83a7-5d5c16ade343 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:42.674787 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3ce9cab0-4381-4d01-83a7-5d5c16ade343 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:42.675263 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3ce9cab0-4381-4d01-83a7-5d5c16ade343 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:42.742430 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-12d5c3a0-d9da-4998-a58b-dbad5b89be3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:42.743487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-12d5c3a0-d9da-4998-a58b-dbad5b89be3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:42.750594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-12d5c3a0-d9da-4998-a58b-dbad5b89be3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:42.751147 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-12d5c3a0-d9da-4998-a58b-dbad5b89be3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:42.752012 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-12d5c3a0-d9da-4998-a58b-dbad5b89be3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:42.752521 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-12d5c3a0-d9da-4998-a58b-dbad5b89be3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:42.973313 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-12d5c3a0-d9da-4998-a58b-dbad5b89be3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:42.982183 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-12d5c3a0-d9da-4998-a58b-dbad5b89be3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.245007 May 17 22:09:42.982771 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 45/90] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:42 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:43.030009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7377de6d-972c-4fd4-a79c-cd6e2e180591 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:43.030713 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7377de6d-972c-4fd4-a79c-cd6e2e180591 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:43.037302 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7377de6d-972c-4fd4-a79c-cd6e2e180591 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:43.037778 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7377de6d-972c-4fd4-a79c-cd6e2e180591 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:43.038574 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7377de6d-972c-4fd4-a79c-cd6e2e180591 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:43.039010 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7377de6d-972c-4fd4-a79c-cd6e2e180591 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:43.175046 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7377de6d-972c-4fd4-a79c-cd6e2e180591 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:43.183244 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7377de6d-972c-4fd4-a79c-cd6e2e180591 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.157045 May 17 22:09:43.184058 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 46/91] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:43 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:43.464318 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-00d56e64-0538-4da0-8b3f-cbc4c0c7a4c2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:43.464963 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-00d56e64-0538-4da0-8b3f-cbc4c0c7a4c2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:43.471709 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00d56e64-0538-4da0-8b3f-cbc4c0c7a4c2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:43.472152 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00d56e64-0538-4da0-8b3f-cbc4c0c7a4c2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:43.472917 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00d56e64-0538-4da0-8b3f-cbc4c0c7a4c2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:43.473345 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-00d56e64-0538-4da0-8b3f-cbc4c0c7a4c2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:43.612352 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-00d56e64-0538-4da0-8b3f-cbc4c0c7a4c2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:43.620988 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-00d56e64-0538-4da0-8b3f-cbc4c0c7a4c2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.162234 May 17 22:09:43.621551 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 47/92] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:43 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:43.625968 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ac33a46b-3c75-4757-a409-c418ad52bd4b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:43.626650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ac33a46b-3c75-4757-a409-c418ad52bd4b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:43.635303 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ac33a46b-3c75-4757-a409-c418ad52bd4b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:43.635761 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ac33a46b-3c75-4757-a409-c418ad52bd4b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:43.636560 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ac33a46b-3c75-4757-a409-c418ad52bd4b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:43.636991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ac33a46b-3c75-4757-a409-c418ad52bd4b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:43.768488 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ac33a46b-3c75-4757-a409-c418ad52bd4b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:43.777249 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ac33a46b-3c75-4757-a409-c418ad52bd4b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:43.778786 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ac33a46b-3c75-4757-a409-c418ad52bd4b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:43.779970 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ac33a46b-3c75-4757-a409-c418ad52bd4b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.157492 May 17 22:09:43.780574 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 48/93] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:43 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:44.001591 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ee8a667a-3f8a-448d-aacb-48686290997b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:44.002226 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ee8a667a-3f8a-448d-aacb-48686290997b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:44.008662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ee8a667a-3f8a-448d-aacb-48686290997b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:44.009109 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ee8a667a-3f8a-448d-aacb-48686290997b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:44.010184 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ee8a667a-3f8a-448d-aacb-48686290997b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:44.010948 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ee8a667a-3f8a-448d-aacb-48686290997b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:44.515759 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ee8a667a-3f8a-448d-aacb-48686290997b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:44.525435 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ee8a667a-3f8a-448d-aacb-48686290997b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.527632 May 17 22:09:44.526018 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 49/94] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:43 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:44.530889 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dde28d6f-2119-46f4-8831-bbae996a9d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:44.531522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dde28d6f-2119-46f4-8831-bbae996a9d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:44.538221 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dde28d6f-2119-46f4-8831-bbae996a9d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:44.538668 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dde28d6f-2119-46f4-8831-bbae996a9d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:44.539831 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dde28d6f-2119-46f4-8831-bbae996a9d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:44.540269 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dde28d6f-2119-46f4-8831-bbae996a9d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:44.779351 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3ce9cab0-4381-4d01-83a7-5d5c16ade343 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "POST /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.117226 May 17 22:09:44.781065 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 46/95] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:09:42 2022] POST /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6/os-volume_attachments => generated 194 bytes in 2120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:44.798971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ac6cf1cd-8d64-4b0e-8e57-cfdbb375d96d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:44.801011 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ac6cf1cd-8d64-4b0e-8e57-cfdbb375d96d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:44.815804 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ac6cf1cd-8d64-4b0e-8e57-cfdbb375d96d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:44.816497 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ac6cf1cd-8d64-4b0e-8e57-cfdbb375d96d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:44.817526 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ac6cf1cd-8d64-4b0e-8e57-cfdbb375d96d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:44.818178 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ac6cf1cd-8d64-4b0e-8e57-cfdbb375d96d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:44.901271 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dde28d6f-2119-46f4-8831-bbae996a9d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:44.920686 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dde28d6f-2119-46f4-8831-bbae996a9d5a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.390141 May 17 22:09:44.921512 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 50/96] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:44 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:44.926928 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ae605366-8a39-43e9-849d-9858fc084b7e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:44.929576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ae605366-8a39-43e9-849d-9858fc084b7e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:44.936385 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae605366-8a39-43e9-849d-9858fc084b7e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:44.937298 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae605366-8a39-43e9-849d-9858fc084b7e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:44.938708 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae605366-8a39-43e9-849d-9858fc084b7e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:44.940214 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae605366-8a39-43e9-849d-9858fc084b7e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:45.168768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ac6cf1cd-8d64-4b0e-8e57-cfdbb375d96d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:45.180992 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ac6cf1cd-8d64-4b0e-8e57-cfdbb375d96d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.397811 May 17 22:09:45.181572 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 47/97] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:44 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:45.186741 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-990fb0ae-0aad-4655-b704-a1a6bc7a4b35 req-5ba80fbe-0447-44b1-8657-bee1b31a28bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f605a2f-287e-4adb-8178-2e2a76f6303f", "name": "network-vif-plugged", "status": "completed", "tag": "2f43fb3e-b8f4-499d-888d-e9a598121d47"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:45.195554 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-990fb0ae-0aad-4655-b704-a1a6bc7a4b35 req-5ba80fbe-0447-44b1-8657-bee1b31a28bb service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:45.196351 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-990fb0ae-0aad-4655-b704-a1a6bc7a4b35 req-5ba80fbe-0447-44b1-8657-bee1b31a28bb service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:45.212895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-990fb0ae-0aad-4655-b704-a1a6bc7a4b35 req-5ba80fbe-0447-44b1-8657-bee1b31a28bb service nova] Creating event network-vif-plugged:2f43fb3e-b8f4-499d-888d-e9a598121d47 for instance 0f605a2f-287e-4adb-8178-2e2a76f6303f on hv-cinder-83998 May 17 22:09:45.213053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ae605366-8a39-43e9-849d-9858fc084b7e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:45.218610 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-990fb0ae-0aad-4655-b704-a1a6bc7a4b35 req-5ba80fbe-0447-44b1-8657-bee1b31a28bb service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035598 May 17 22:09:45.219233 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 48/98] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:45.222379 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ae605366-8a39-43e9-849d-9858fc084b7e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:45.223971 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ae605366-8a39-43e9-849d-9858fc084b7e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:45.226991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ae605366-8a39-43e9-849d-9858fc084b7e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.303881 May 17 22:09:45.228141 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 51/99] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:44 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:45.542950 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7d1f9979-db55-4a72-838f-28e2c1d0b992 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:45.543666 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7d1f9979-db55-4a72-838f-28e2c1d0b992 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:45.550513 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d1f9979-db55-4a72-838f-28e2c1d0b992 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:45.551140 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d1f9979-db55-4a72-838f-28e2c1d0b992 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:45.551946 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d1f9979-db55-4a72-838f-28e2c1d0b992 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:45.552958 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d1f9979-db55-4a72-838f-28e2c1d0b992 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:45.719560 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7d1f9979-db55-4a72-838f-28e2c1d0b992 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:45.729970 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7d1f9979-db55-4a72-838f-28e2c1d0b992 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.191095 May 17 22:09:45.730534 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 49/100] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:45 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:45.940194 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-02adb934-d051-4f82-b9bc-7a4a36ffad5f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:45.940962 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-02adb934-d051-4f82-b9bc-7a4a36ffad5f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:45.947687 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-02adb934-d051-4f82-b9bc-7a4a36ffad5f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:45.948142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-02adb934-d051-4f82-b9bc-7a4a36ffad5f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:45.949092 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-02adb934-d051-4f82-b9bc-7a4a36ffad5f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:45.949535 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-02adb934-d051-4f82-b9bc-7a4a36ffad5f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:46.123644 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-02adb934-d051-4f82-b9bc-7a4a36ffad5f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:46.132868 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-02adb934-d051-4f82-b9bc-7a4a36ffad5f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.196655 May 17 22:09:46.133503 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 52/101] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:45 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:46.198745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-57c93ee9-853b-4cfd-8bb7-819027ae9a5c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:46.199395 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-57c93ee9-853b-4cfd-8bb7-819027ae9a5c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:46.206096 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57c93ee9-853b-4cfd-8bb7-819027ae9a5c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:46.206852 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57c93ee9-853b-4cfd-8bb7-819027ae9a5c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:46.207833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57c93ee9-853b-4cfd-8bb7-819027ae9a5c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:46.208466 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-57c93ee9-853b-4cfd-8bb7-819027ae9a5c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:46.248156 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-56dead78-0984-4193-99a4-dfee0e935c83 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:46.249694 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-56dead78-0984-4193-99a4-dfee0e935c83 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:46.261045 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-56dead78-0984-4193-99a4-dfee0e935c83 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:46.262001 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-56dead78-0984-4193-99a4-dfee0e935c83 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:46.263063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-56dead78-0984-4193-99a4-dfee0e935c83 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:46.264149 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-56dead78-0984-4193-99a4-dfee0e935c83 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:46.541401 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-57c93ee9-853b-4cfd-8bb7-819027ae9a5c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:46.548890 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-57c93ee9-853b-4cfd-8bb7-819027ae9a5c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.354097 May 17 22:09:46.549471 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 50/102] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:46 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:46.588866 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-56dead78-0984-4193-99a4-dfee0e935c83 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:46.596864 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-56dead78-0984-4193-99a4-dfee0e935c83 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:46.598712 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-56dead78-0984-4193-99a4-dfee0e935c83 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:46.600293 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-56dead78-0984-4193-99a4-dfee0e935c83 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.358355 May 17 22:09:46.600943 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 53/103] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:46 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:46.749736 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7275e0d2-215c-4f84-a3c1-7712b0e7636a tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:46.749736 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7275e0d2-215c-4f84-a3c1-7712b0e7636a tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:46.758562 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7275e0d2-215c-4f84-a3c1-7712b0e7636a tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:46.760412 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7275e0d2-215c-4f84-a3c1-7712b0e7636a tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:46.761255 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7275e0d2-215c-4f84-a3c1-7712b0e7636a tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:46.761787 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7275e0d2-215c-4f84-a3c1-7712b0e7636a tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:46.901232 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7275e0d2-215c-4f84-a3c1-7712b0e7636a tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:46.909090 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7275e0d2-215c-4f84-a3c1-7712b0e7636a tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.165471 May 17 22:09:46.909685 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 51/104] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:46 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:47.150976 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-16466bd4-29f9-4d1e-9e71-f625f724c1fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:47.151612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-16466bd4-29f9-4d1e-9e71-f625f724c1fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:47.158384 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-16466bd4-29f9-4d1e-9e71-f625f724c1fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:47.158880 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-16466bd4-29f9-4d1e-9e71-f625f724c1fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:47.159671 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-16466bd4-29f9-4d1e-9e71-f625f724c1fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:47.160099 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-16466bd4-29f9-4d1e-9e71-f625f724c1fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:47.289139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-16466bd4-29f9-4d1e-9e71-f625f724c1fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:47.297127 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-16466bd4-29f9-4d1e-9e71-f625f724c1fb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.150689 May 17 22:09:47.297769 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 54/105] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:47 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:47.565741 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e9ae5975-9d38-4555-959c-c2313e4238a7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:47.566463 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e9ae5975-9d38-4555-959c-c2313e4238a7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:47.573582 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e9ae5975-9d38-4555-959c-c2313e4238a7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:47.574035 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e9ae5975-9d38-4555-959c-c2313e4238a7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:47.574803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e9ae5975-9d38-4555-959c-c2313e4238a7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:47.575268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e9ae5975-9d38-4555-959c-c2313e4238a7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:47.619096 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e0d5332e-a2ba-4884-a38e-d8c89f00f7b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:47.619718 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e0d5332e-a2ba-4884-a38e-d8c89f00f7b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:47.625818 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0d5332e-a2ba-4884-a38e-d8c89f00f7b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:47.626544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0d5332e-a2ba-4884-a38e-d8c89f00f7b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:47.627534 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0d5332e-a2ba-4884-a38e-d8c89f00f7b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:47.627984 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e0d5332e-a2ba-4884-a38e-d8c89f00f7b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:47.774471 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e9ae5975-9d38-4555-959c-c2313e4238a7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:47.787794 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e0d5332e-a2ba-4884-a38e-d8c89f00f7b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:47.791467 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e9ae5975-9d38-4555-959c-c2313e4238a7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.229415 May 17 22:09:47.792105 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 52/106] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:47 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:47.796169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e0d5332e-a2ba-4884-a38e-d8c89f00f7b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:47.797672 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e0d5332e-a2ba-4884-a38e-d8c89f00f7b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:47.799045 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e0d5332e-a2ba-4884-a38e-d8c89f00f7b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.184806 May 17 22:09:47.799629 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 55/107] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:47 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:09:47.925650 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6f019eb8-2fc2-42d0-a4e4-08821c572c5d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:47.926297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6f019eb8-2fc2-42d0-a4e4-08821c572c5d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:47.932173 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6f019eb8-2fc2-42d0-a4e4-08821c572c5d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:47.932624 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6f019eb8-2fc2-42d0-a4e4-08821c572c5d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:47.933389 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6f019eb8-2fc2-42d0-a4e4-08821c572c5d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:47.934085 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6f019eb8-2fc2-42d0-a4e4-08821c572c5d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:48.063767 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6f019eb8-2fc2-42d0-a4e4-08821c572c5d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:48.071465 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6f019eb8-2fc2-42d0-a4e4-08821c572c5d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.149535 May 17 22:09:48.072049 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 53/108] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:47 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:48.314483 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7600e4e7-00c2-49f1-8f47-b493787a0df9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:48.315093 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7600e4e7-00c2-49f1-8f47-b493787a0df9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:48.321322 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7600e4e7-00c2-49f1-8f47-b493787a0df9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:48.321774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7600e4e7-00c2-49f1-8f47-b493787a0df9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:48.322541 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7600e4e7-00c2-49f1-8f47-b493787a0df9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:48.322975 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7600e4e7-00c2-49f1-8f47-b493787a0df9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:48.452164 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7600e4e7-00c2-49f1-8f47-b493787a0df9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:48.459309 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7600e4e7-00c2-49f1-8f47-b493787a0df9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.148588 May 17 22:09:48.464979 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 56/109] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:48 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:48.809375 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b6c32eb0-ab4f-4da3-a44b-b2e48bd7b3a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:48.810039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b6c32eb0-ab4f-4da3-a44b-b2e48bd7b3a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:48.816479 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6c32eb0-ab4f-4da3-a44b-b2e48bd7b3a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:48.816861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6c32eb0-ab4f-4da3-a44b-b2e48bd7b3a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:48.816999 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e35430bd-b25a-431d-b62b-88de290b5728 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:48.817635 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6c32eb0-ab4f-4da3-a44b-b2e48bd7b3a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:48.818484 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e35430bd-b25a-431d-b62b-88de290b5728 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:48.818858 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6c32eb0-ab4f-4da3-a44b-b2e48bd7b3a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:48.824498 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e35430bd-b25a-431d-b62b-88de290b5728 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:48.824972 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e35430bd-b25a-431d-b62b-88de290b5728 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:48.827075 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e35430bd-b25a-431d-b62b-88de290b5728 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:48.827075 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e35430bd-b25a-431d-b62b-88de290b5728 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:49.017838 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b6c32eb0-ab4f-4da3-a44b-b2e48bd7b3a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:49.029870 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b6c32eb0-ab4f-4da3-a44b-b2e48bd7b3a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.224488 May 17 22:09:49.030312 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e35430bd-b25a-431d-b62b-88de290b5728 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:49.031085 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 54/110] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:48 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:49.039984 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e35430bd-b25a-431d-b62b-88de290b5728 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:49.041570 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e35430bd-b25a-431d-b62b-88de290b5728 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:49.042850 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e35430bd-b25a-431d-b62b-88de290b5728 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.229844 May 17 22:09:49.043442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 57/111] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:48 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:09:49.088551 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b73f4f47-aad3-45f1-a2a7-18fb82a3f7d8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:49.089737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b73f4f47-aad3-45f1-a2a7-18fb82a3f7d8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:49.096028 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b73f4f47-aad3-45f1-a2a7-18fb82a3f7d8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:49.096915 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b73f4f47-aad3-45f1-a2a7-18fb82a3f7d8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:49.097855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b73f4f47-aad3-45f1-a2a7-18fb82a3f7d8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:49.098475 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b73f4f47-aad3-45f1-a2a7-18fb82a3f7d8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:49.238746 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b73f4f47-aad3-45f1-a2a7-18fb82a3f7d8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:49.246585 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b73f4f47-aad3-45f1-a2a7-18fb82a3f7d8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.162202 May 17 22:09:49.247169 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 55/112] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:49 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:49.476570 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7d724270-e18e-41f5-9fbc-7df2d52f1994 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:49.477270 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7d724270-e18e-41f5-9fbc-7df2d52f1994 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:49.482999 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d724270-e18e-41f5-9fbc-7df2d52f1994 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:49.483471 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d724270-e18e-41f5-9fbc-7df2d52f1994 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:49.484280 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d724270-e18e-41f5-9fbc-7df2d52f1994 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:49.484718 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d724270-e18e-41f5-9fbc-7df2d52f1994 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:49.637613 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7d724270-e18e-41f5-9fbc-7df2d52f1994 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:49.644870 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7d724270-e18e-41f5-9fbc-7df2d52f1994 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.172965 May 17 22:09:49.645434 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 58/113] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:49 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:50.049305 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e2613365-9643-479a-a134-c52f461b6bef tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:50.049955 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e2613365-9643-479a-a134-c52f461b6bef tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:50.062177 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3c904107-5775-4af5-b79e-f52f8d90033a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:50.062778 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3c904107-5775-4af5-b79e-f52f8d90033a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:50.069491 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e2613365-9643-479a-a134-c52f461b6bef tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:50.069969 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e2613365-9643-479a-a134-c52f461b6bef tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:50.071792 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e2613365-9643-479a-a134-c52f461b6bef tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:50.072231 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e2613365-9643-479a-a134-c52f461b6bef tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:50.075778 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3c904107-5775-4af5-b79e-f52f8d90033a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:50.076228 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3c904107-5775-4af5-b79e-f52f8d90033a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:50.077011 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3c904107-5775-4af5-b79e-f52f8d90033a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:50.077438 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3c904107-5775-4af5-b79e-f52f8d90033a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:50.286075 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3c904107-5775-4af5-b79e-f52f8d90033a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:50.300950 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e2613365-9643-479a-a134-c52f461b6bef tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:50.302563 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3c904107-5775-4af5-b79e-f52f8d90033a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:50.304718 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3c904107-5775-4af5-b79e-f52f8d90033a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:50.306543 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3c904107-5775-4af5-b79e-f52f8d90033a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.247879 May 17 22:09:50.307460 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 59/114] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:50 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:09:50.310815 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e2613365-9643-479a-a134-c52f461b6bef tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.265619 May 17 22:09:50.312604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0ab0ae7d-bd93-4f86-ab53-d578cabe0ee8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:50.313287 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0ab0ae7d-bd93-4f86-ab53-d578cabe0ee8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:50.319665 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ab0ae7d-bd93-4f86-ab53-d578cabe0ee8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:50.320121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ab0ae7d-bd93-4f86-ab53-d578cabe0ee8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:50.320508 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 56/115] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:50 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:50.320987 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ab0ae7d-bd93-4f86-ab53-d578cabe0ee8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:50.321459 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ab0ae7d-bd93-4f86-ab53-d578cabe0ee8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:50.466567 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0ab0ae7d-bd93-4f86-ab53-d578cabe0ee8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:50.474790 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0ab0ae7d-bd93-4f86-ab53-d578cabe0ee8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1322 microversion: 2.1 time: 0.165617 May 17 22:09:50.475554 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 60/116] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:50 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:50.661683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-332ce05e-f4dc-4df9-9b5c-bda1a0d2a58a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:50.662359 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-332ce05e-f4dc-4df9-9b5c-bda1a0d2a58a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:50.668038 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-332ce05e-f4dc-4df9-9b5c-bda1a0d2a58a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:50.668702 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-332ce05e-f4dc-4df9-9b5c-bda1a0d2a58a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:50.669473 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-332ce05e-f4dc-4df9-9b5c-bda1a0d2a58a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:50.669903 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-332ce05e-f4dc-4df9-9b5c-bda1a0d2a58a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:50.819611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-332ce05e-f4dc-4df9-9b5c-bda1a0d2a58a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:50.827094 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-332ce05e-f4dc-4df9-9b5c-bda1a0d2a58a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.169143 May 17 22:09:50.831188 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 57/117] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:50 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:51.330983 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5d8c76f8-765f-49aa-afe8-7bef5cdb0b03 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:51.331667 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5d8c76f8-765f-49aa-afe8-7bef5cdb0b03 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:51.332458 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-20a3cda1-61be-4375-a502-b42a6716d13d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:51.333108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-20a3cda1-61be-4375-a502-b42a6716d13d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:51.341792 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5d8c76f8-765f-49aa-afe8-7bef5cdb0b03 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:51.342061 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-20a3cda1-61be-4375-a502-b42a6716d13d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:51.342655 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-20a3cda1-61be-4375-a502-b42a6716d13d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:51.342899 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5d8c76f8-765f-49aa-afe8-7bef5cdb0b03 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:51.343984 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-20a3cda1-61be-4375-a502-b42a6716d13d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:51.344106 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5d8c76f8-765f-49aa-afe8-7bef5cdb0b03 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:51.344689 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5d8c76f8-765f-49aa-afe8-7bef5cdb0b03 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:51.345310 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-20a3cda1-61be-4375-a502-b42a6716d13d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:51.557062 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-20a3cda1-61be-4375-a502-b42a6716d13d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:51.558146 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5d8c76f8-765f-49aa-afe8-7bef5cdb0b03 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:51.568221 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-20a3cda1-61be-4375-a502-b42a6716d13d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:51.569050 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5d8c76f8-765f-49aa-afe8-7bef5cdb0b03 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.241694 May 17 22:09:51.570198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 58/118] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:51 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:51.574695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-1ba64f53-af0a-48f3-95d1-573068c977d2 req-e709d09f-7bde-499f-b647-fcda0c2d4594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485c3cc1-ede2-4e51-ac41-c00abe07926e", "name": "network-vif-plugged", "status": "completed", "tag": "43990b62-6cdf-4ffd-9e88-4f471ea665e1"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:51.575915 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-20a3cda1-61be-4375-a502-b42a6716d13d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:51.578539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-20a3cda1-61be-4375-a502-b42a6716d13d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.257292 May 17 22:09:51.579861 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 61/119] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:51 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:51.584779 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-aba15d73-880d-4886-b571-aa26698c3c20 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:51.586427 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-aba15d73-880d-4886-b571-aa26698c3c20 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:51.588407 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-1ba64f53-af0a-48f3-95d1-573068c977d2 req-e709d09f-7bde-499f-b647-fcda0c2d4594 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:51.589009 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-1ba64f53-af0a-48f3-95d1-573068c977d2 req-e709d09f-7bde-499f-b647-fcda0c2d4594 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:51.593132 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aba15d73-880d-4886-b571-aa26698c3c20 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:51.593764 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aba15d73-880d-4886-b571-aa26698c3c20 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:51.594514 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aba15d73-880d-4886-b571-aa26698c3c20 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:51.595037 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aba15d73-880d-4886-b571-aa26698c3c20 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:51.612264 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-1ba64f53-af0a-48f3-95d1-573068c977d2 req-e709d09f-7bde-499f-b647-fcda0c2d4594 service nova] Creating event network-vif-plugged:43990b62-6cdf-4ffd-9e88-4f471ea665e1 for instance 485c3cc1-ede2-4e51-ac41-c00abe07926e on hv-cinder-83998 May 17 22:09:51.618550 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-1ba64f53-af0a-48f3-95d1-573068c977d2 req-e709d09f-7bde-499f-b647-fcda0c2d4594 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046965 May 17 22:09:51.620217 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 59/120] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:51.735533 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-aba15d73-880d-4886-b571-aa26698c3c20 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:51.742846 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-aba15d73-880d-4886-b571-aa26698c3c20 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1516 microversion: 2.1 time: 0.161799 May 17 22:09:51.743452 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 62/121] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:51 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:51.760373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-66685e34-6b78-4daf-8b6f-50b7dac78485 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:51.761383 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-66685e34-6b78-4daf-8b6f-50b7dac78485 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:51.767516 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66685e34-6b78-4daf-8b6f-50b7dac78485 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:51.767957 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66685e34-6b78-4daf-8b6f-50b7dac78485 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:51.768709 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66685e34-6b78-4daf-8b6f-50b7dac78485 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:51.769135 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66685e34-6b78-4daf-8b6f-50b7dac78485 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:51.805903 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-66685e34-6b78-4daf-8b6f-50b7dac78485 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lazy-loading 'flavor' on Instance uuid 0f605a2f-287e-4adb-8178-2e2a76f6303f {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:09:51.847158 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9b5e8938-d48b-4396-8175-f3c017bac59f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:51.851847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9b5e8938-d48b-4396-8175-f3c017bac59f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:51.862030 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b5e8938-d48b-4396-8175-f3c017bac59f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:51.862485 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b5e8938-d48b-4396-8175-f3c017bac59f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:51.863292 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b5e8938-d48b-4396-8175-f3c017bac59f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:51.863727 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b5e8938-d48b-4396-8175-f3c017bac59f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:52.117749 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9b5e8938-d48b-4396-8175-f3c017bac59f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:52.126023 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9b5e8938-d48b-4396-8175-f3c017bac59f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.284811 May 17 22:09:52.126965 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 63/122] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:51 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:52.270329 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-66685e34-6b78-4daf-8b6f-50b7dac78485 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "POST /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f/action" status: 200 len: 32 microversion: 2.1 time: 0.514292 May 17 22:09:52.273472 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 60/123] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:09:51 2022] POST /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f/action => generated 32 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 22:09:52.280070 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b657c58c-79d7-4203-858f-284fc2e7e02e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:52.280667 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b657c58c-79d7-4203-858f-284fc2e7e02e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:52.287200 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b657c58c-79d7-4203-858f-284fc2e7e02e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:52.288128 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b657c58c-79d7-4203-858f-284fc2e7e02e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:52.288899 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b657c58c-79d7-4203-858f-284fc2e7e02e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:52.289315 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b657c58c-79d7-4203-858f-284fc2e7e02e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:52.420964 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b657c58c-79d7-4203-858f-284fc2e7e02e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:52.430341 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b657c58c-79d7-4203-858f-284fc2e7e02e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.154134 May 17 22:09:52.430948 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 64/124] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:52 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:52.592569 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-393e568f-71e7-4d12-9fa3-94d5a5e7fb37 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:52.594104 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-393e568f-71e7-4d12-9fa3-94d5a5e7fb37 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:52.598096 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b18d6138-0aae-4734-ab37-dfcac4cfe8e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:52.600477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b18d6138-0aae-4734-ab37-dfcac4cfe8e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:52.604523 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-393e568f-71e7-4d12-9fa3-94d5a5e7fb37 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:52.612495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-393e568f-71e7-4d12-9fa3-94d5a5e7fb37 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:52.612495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-393e568f-71e7-4d12-9fa3-94d5a5e7fb37 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:52.612495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-393e568f-71e7-4d12-9fa3-94d5a5e7fb37 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:52.613034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b18d6138-0aae-4734-ab37-dfcac4cfe8e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:52.613421 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b18d6138-0aae-4734-ab37-dfcac4cfe8e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:52.614203 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b18d6138-0aae-4734-ab37-dfcac4cfe8e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:52.615374 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b18d6138-0aae-4734-ab37-dfcac4cfe8e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:52.834780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b18d6138-0aae-4734-ab37-dfcac4cfe8e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:52.844314 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b18d6138-0aae-4734-ab37-dfcac4cfe8e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:52.845319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-393e568f-71e7-4d12-9fa3-94d5a5e7fb37 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:52.853540 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b18d6138-0aae-4734-ab37-dfcac4cfe8e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:52.853540 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b18d6138-0aae-4734-ab37-dfcac4cfe8e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.253518 May 17 22:09:52.853540 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 65/125] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:52 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:52.853822 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-393e568f-71e7-4d12-9fa3-94d5a5e7fb37 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.267435 May 17 22:09:52.854217 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 61/126] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:52 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:53.143760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-feedf8a6-2ba2-405f-aeaf-9544ee988e38 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:53.144358 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-feedf8a6-2ba2-405f-aeaf-9544ee988e38 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:53.151316 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-feedf8a6-2ba2-405f-aeaf-9544ee988e38 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:53.151766 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-feedf8a6-2ba2-405f-aeaf-9544ee988e38 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:53.152596 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-feedf8a6-2ba2-405f-aeaf-9544ee988e38 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:53.153104 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-feedf8a6-2ba2-405f-aeaf-9544ee988e38 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:53.369329 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-feedf8a6-2ba2-405f-aeaf-9544ee988e38 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:53.377335 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-feedf8a6-2ba2-405f-aeaf-9544ee988e38 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.237320 May 17 22:09:53.377896 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 66/127] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:53 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:53.447765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c61d7e59-1b44-4e6e-bc8b-6e4885ad2bdf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:53.448508 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c61d7e59-1b44-4e6e-bc8b-6e4885ad2bdf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:53.454505 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c61d7e59-1b44-4e6e-bc8b-6e4885ad2bdf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:53.454950 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c61d7e59-1b44-4e6e-bc8b-6e4885ad2bdf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:53.455801 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c61d7e59-1b44-4e6e-bc8b-6e4885ad2bdf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:53.456230 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c61d7e59-1b44-4e6e-bc8b-6e4885ad2bdf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:53.586249 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c61d7e59-1b44-4e6e-bc8b-6e4885ad2bdf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:53.594226 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c61d7e59-1b44-4e6e-bc8b-6e4885ad2bdf tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.150511 May 17 22:09:53.594838 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 62/128] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:53 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:53.639508 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-995b918a-65f6-4cec-a423-4c56dd2df1d0 req-c1a16401-a4d2-491d-982a-6c618f9966e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c568a7b-6b45-45c4-b60a-3514d7c43e6e", "name": "network-vif-plugged", "status": "completed", "tag": "501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e"}, {"server_uuid": "65e6e64e-c18e-4856-9a95-0833c10482ee", "name": "network-vif-plugged", "status": "completed", "tag": "de95285b-0a74-427f-90f8-1b48b78cd597"}, {"server_uuid": "120f12ef-0f38-41f4-a47d-2fdb6ffe8831", "name": "network-vif-plugged", "status": "completed", "tag": "6bf3020e-df21-491a-8ec0-6c8d0f806985"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:09:53.649889 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-995b918a-65f6-4cec-a423-4c56dd2df1d0 req-c1a16401-a4d2-491d-982a-6c618f9966e5 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:53.650385 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-995b918a-65f6-4cec-a423-4c56dd2df1d0 req-c1a16401-a4d2-491d-982a-6c618f9966e5 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:53.679154 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-995b918a-65f6-4cec-a423-4c56dd2df1d0 req-c1a16401-a4d2-491d-982a-6c618f9966e5 service nova] Creating event network-vif-plugged:501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e for instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e on hv-cinder-83998 May 17 22:09:53.679665 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-995b918a-65f6-4cec-a423-4c56dd2df1d0 req-c1a16401-a4d2-491d-982a-6c618f9966e5 service nova] Creating event network-vif-plugged:de95285b-0a74-427f-90f8-1b48b78cd597 for instance 65e6e64e-c18e-4856-9a95-0833c10482ee on hv-cinder-83998 May 17 22:09:53.680191 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-995b918a-65f6-4cec-a423-4c56dd2df1d0 req-c1a16401-a4d2-491d-982a-6c618f9966e5 service nova] Creating event network-vif-plugged:6bf3020e-df21-491a-8ec0-6c8d0f806985 for instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 on hv-cinder-83998 May 17 22:09:53.688775 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-995b918a-65f6-4cec-a423-4c56dd2df1d0 req-c1a16401-a4d2-491d-982a-6c618f9966e5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.053011 May 17 22:09:53.689395 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 67/129] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:53.866565 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-30af8890-9259-4c6e-a7db-ac38ce2b810a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:53.867313 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-30af8890-9259-4c6e-a7db-ac38ce2b810a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:53.871214 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8be14f38-d884-4386-a4ef-4830c4167101 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:53.871917 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8be14f38-d884-4386-a4ef-4830c4167101 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:53.874175 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-30af8890-9259-4c6e-a7db-ac38ce2b810a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:53.874805 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-30af8890-9259-4c6e-a7db-ac38ce2b810a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:53.875483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-30af8890-9259-4c6e-a7db-ac38ce2b810a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:53.875935 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-30af8890-9259-4c6e-a7db-ac38ce2b810a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:53.880691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8be14f38-d884-4386-a4ef-4830c4167101 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:53.886321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8be14f38-d884-4386-a4ef-4830c4167101 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:53.886321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8be14f38-d884-4386-a4ef-4830c4167101 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:53.886321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8be14f38-d884-4386-a4ef-4830c4167101 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:54.471250 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8be14f38-d884-4386-a4ef-4830c4167101 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:54.477049 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-30af8890-9259-4c6e-a7db-ac38ce2b810a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:54.487229 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8be14f38-d884-4386-a4ef-4830c4167101 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.620177 May 17 22:09:54.488280 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 68/130] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:53 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:54.496744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-30af8890-9259-4c6e-a7db-ac38ce2b810a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:54.497620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-54e58422-134e-4b86-8df6-502f0a099a0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:54.498940 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-30af8890-9259-4c6e-a7db-ac38ce2b810a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:54.499765 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-54e58422-134e-4b86-8df6-502f0a099a0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:54.500218 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-30af8890-9259-4c6e-a7db-ac38ce2b810a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.638222 May 17 22:09:54.511182 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 63/131] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:53 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:54.516560 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54e58422-134e-4b86-8df6-502f0a099a0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:54.517392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54e58422-134e-4b86-8df6-502f0a099a0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:54.519027 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54e58422-134e-4b86-8df6-502f0a099a0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:54.519673 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54e58422-134e-4b86-8df6-502f0a099a0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:54.611375 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bd9e6add-1f83-4a62-b95a-eeda2d9eaf3d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:54.612497 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bd9e6add-1f83-4a62-b95a-eeda2d9eaf3d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:54.619597 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd9e6add-1f83-4a62-b95a-eeda2d9eaf3d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:54.620271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd9e6add-1f83-4a62-b95a-eeda2d9eaf3d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:54.621200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd9e6add-1f83-4a62-b95a-eeda2d9eaf3d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:54.621778 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd9e6add-1f83-4a62-b95a-eeda2d9eaf3d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:54.797926 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-54e58422-134e-4b86-8df6-502f0a099a0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:54.811831 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-54e58422-134e-4b86-8df6-502f0a099a0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.321753 May 17 22:09:54.811987 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 69/132] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:54 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:54.830930 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bd9e6add-1f83-4a62-b95a-eeda2d9eaf3d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:54.839044 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bd9e6add-1f83-4a62-b95a-eeda2d9eaf3d tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.231625 May 17 22:09:54.839660 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 64/133] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:54 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:55.506886 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eb32c65e-0635-4833-a623-5caecd4260f3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:55.507844 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eb32c65e-0635-4833-a623-5caecd4260f3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:55.518524 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d55bf986-501c-4baa-8641-5f9485690bca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:55.518907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d55bf986-501c-4baa-8641-5f9485690bca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:55.527574 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb32c65e-0635-4833-a623-5caecd4260f3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:55.528017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb32c65e-0635-4833-a623-5caecd4260f3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:55.529099 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb32c65e-0635-4833-a623-5caecd4260f3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:55.529992 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d55bf986-501c-4baa-8641-5f9485690bca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:55.530109 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb32c65e-0635-4833-a623-5caecd4260f3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:55.530621 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d55bf986-501c-4baa-8641-5f9485690bca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:55.531569 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d55bf986-501c-4baa-8641-5f9485690bca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:55.532124 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d55bf986-501c-4baa-8641-5f9485690bca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:55.725374 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eb32c65e-0635-4833-a623-5caecd4260f3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:55.728536 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d55bf986-501c-4baa-8641-5f9485690bca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:55.732766 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eb32c65e-0635-4833-a623-5caecd4260f3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.230330 May 17 22:09:55.733333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 70/134] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:55 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:55.736302 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d55bf986-501c-4baa-8641-5f9485690bca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:55.738046 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d55bf986-501c-4baa-8641-5f9485690bca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:55.740491 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d55bf986-501c-4baa-8641-5f9485690bca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.226490 May 17 22:09:55.741036 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 65/135] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:55 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:55.829796 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8050e82d-90f4-4b7e-a0da-99f438e0b977 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:55.830560 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8050e82d-90f4-4b7e-a0da-99f438e0b977 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:55.837546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8050e82d-90f4-4b7e-a0da-99f438e0b977 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:55.837997 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8050e82d-90f4-4b7e-a0da-99f438e0b977 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:55.838770 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8050e82d-90f4-4b7e-a0da-99f438e0b977 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:55.839232 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8050e82d-90f4-4b7e-a0da-99f438e0b977 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:55.857855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-03cdd011-e105-4318-b03f-4433c1c8482c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:55.858504 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-03cdd011-e105-4318-b03f-4433c1c8482c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:55.864600 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03cdd011-e105-4318-b03f-4433c1c8482c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:55.867515 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03cdd011-e105-4318-b03f-4433c1c8482c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:55.867515 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03cdd011-e105-4318-b03f-4433c1c8482c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:55.867515 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03cdd011-e105-4318-b03f-4433c1c8482c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:55.980609 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8050e82d-90f4-4b7e-a0da-99f438e0b977 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:55.988548 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8050e82d-90f4-4b7e-a0da-99f438e0b977 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.164153 May 17 22:09:55.989207 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 71/136] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:55 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:56.147295 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-03cdd011-e105-4318-b03f-4433c1c8482c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:56.154421 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-03cdd011-e105-4318-b03f-4433c1c8482c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.300525 May 17 22:09:56.154974 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 66/137] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:55 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:56.752652 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ccfe2ca8-8584-4263-bbdd-0f2b0f6b3ecf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:56.752652 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ccfe2ca8-8584-4263-bbdd-0f2b0f6b3ecf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:56.758056 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cffcb3b0-9605-413a-add9-d669dedb8acc tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:56.758878 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cffcb3b0-9605-413a-add9-d669dedb8acc tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:56.766438 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cffcb3b0-9605-413a-add9-d669dedb8acc tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:56.766988 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cffcb3b0-9605-413a-add9-d669dedb8acc tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:56.767886 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cffcb3b0-9605-413a-add9-d669dedb8acc tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:56.768378 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cffcb3b0-9605-413a-add9-d669dedb8acc tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:56.771796 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ccfe2ca8-8584-4263-bbdd-0f2b0f6b3ecf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:56.772609 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ccfe2ca8-8584-4263-bbdd-0f2b0f6b3ecf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:56.773819 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ccfe2ca8-8584-4263-bbdd-0f2b0f6b3ecf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:56.774363 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ccfe2ca8-8584-4263-bbdd-0f2b0f6b3ecf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:57.035808 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cffcb3b0-9605-413a-add9-d669dedb8acc tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:57.036324 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ccfe2ca8-8584-4263-bbdd-0f2b0f6b3ecf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:57.036733 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cffcb3b0-9605-413a-add9-d669dedb8acc tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:57.036733 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cffcb3b0-9605-413a-add9-d669dedb8acc tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:57.036884 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ccfe2ca8-8584-4263-bbdd-0f2b0f6b3ecf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1363 microversion: 2.1 time: 0.253148 May 17 22:09:57.036954 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-cffcb3b0-9605-413a-add9-d669dedb8acc tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1408 microversion: 2.20 time: 0.246549 May 17 22:09:57.037032 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 72/138] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:56 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:57.037101 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 67/139] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:56 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:09:57.037167 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-10198e00-4b9a-4f68-baf2-7517b8d9bc9c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:57.037167 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-10198e00-4b9a-4f68-baf2-7517b8d9bc9c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:57.037167 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10198e00-4b9a-4f68-baf2-7517b8d9bc9c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:57.037167 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10198e00-4b9a-4f68-baf2-7517b8d9bc9c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:57.037408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10198e00-4b9a-4f68-baf2-7517b8d9bc9c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:57.037408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10198e00-4b9a-4f68-baf2-7517b8d9bc9c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:57.166994 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-10198e00-4b9a-4f68-baf2-7517b8d9bc9c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:57.166994 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-10198e00-4b9a-4f68-baf2-7517b8d9bc9c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1364 microversion: 2.1 time: 0.144480 May 17 22:09:57.166994 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 73/140] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:57 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:09:57.171494 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b5c27b72-438c-4f0d-be0b-257d597baf1b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:57.172123 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b5c27b72-438c-4f0d-be0b-257d597baf1b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:57.178029 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5c27b72-438c-4f0d-be0b-257d597baf1b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:57.178540 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5c27b72-438c-4f0d-be0b-257d597baf1b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:57.179400 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5c27b72-438c-4f0d-be0b-257d597baf1b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:57.179839 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5c27b72-438c-4f0d-be0b-257d597baf1b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:57.358440 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b5c27b72-438c-4f0d-be0b-257d597baf1b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:57.364180 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b5c27b72-438c-4f0d-be0b-257d597baf1b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.196543 May 17 22:09:57.364744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 68/141] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:57 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:58.046818 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9299a298-97c8-48f6-a9c7-f04c441c68a8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:58.047456 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9299a298-97c8-48f6-a9c7-f04c441c68a8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:58.051757 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-872ec514-ef46-4788-bdcd-7cf52c6dbb24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:58.052860 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-872ec514-ef46-4788-bdcd-7cf52c6dbb24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:58.053329 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9299a298-97c8-48f6-a9c7-f04c441c68a8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.053803 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9299a298-97c8-48f6-a9c7-f04c441c68a8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.054829 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9299a298-97c8-48f6-a9c7-f04c441c68a8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.055433 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9299a298-97c8-48f6-a9c7-f04c441c68a8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.060466 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-872ec514-ef46-4788-bdcd-7cf52c6dbb24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.061147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-872ec514-ef46-4788-bdcd-7cf52c6dbb24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.062351 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-872ec514-ef46-4788-bdcd-7cf52c6dbb24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.062988 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-872ec514-ef46-4788-bdcd-7cf52c6dbb24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.304299 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-872ec514-ef46-4788-bdcd-7cf52c6dbb24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:58.307288 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9299a298-97c8-48f6-a9c7-f04c441c68a8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:58.313971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-872ec514-ef46-4788-bdcd-7cf52c6dbb24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:58.314920 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9299a298-97c8-48f6-a9c7-f04c441c68a8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1549 microversion: 2.1 time: 0.271762 May 17 22:09:58.327478 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-872ec514-ef46-4788-bdcd-7cf52c6dbb24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:58.327478 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-872ec514-ef46-4788-bdcd-7cf52c6dbb24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1599 microversion: 2.20 time: 0.270173 May 17 22:09:58.327478 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 69/142] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:09:58 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1599 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:09:58.328228 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 74/143] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:58 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1549 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:58.333529 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d1a19211-f061-40b6-a60d-e002fc585c88 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:58.333679 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0084b4f9-10b1-4926-80d5-f287e72f001a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:58.334098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d1a19211-f061-40b6-a60d-e002fc585c88 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:58.334192 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0084b4f9-10b1-4926-80d5-f287e72f001a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:58.342270 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1a19211-f061-40b6-a60d-e002fc585c88 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.343550 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1a19211-f061-40b6-a60d-e002fc585c88 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.354931 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0084b4f9-10b1-4926-80d5-f287e72f001a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.355321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1a19211-f061-40b6-a60d-e002fc585c88 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.355425 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0084b4f9-10b1-4926-80d5-f287e72f001a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.355503 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1a19211-f061-40b6-a60d-e002fc585c88 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.355603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0084b4f9-10b1-4926-80d5-f287e72f001a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.355603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0084b4f9-10b1-4926-80d5-f287e72f001a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.493811 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d1a19211-f061-40b6-a60d-e002fc585c88 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.163835 May 17 22:09:58.494588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 75/144] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 17 22:09:58 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/os-interface => generated 285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:58.500020 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5f0ff63b-2814-459d-912d-509c070c1f2e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:58.515703 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5f0ff63b-2814-459d-912d-509c070c1f2e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:58.516487 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0084b4f9-10b1-4926-80d5-f287e72f001a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:58.523760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f0ff63b-2814-459d-912d-509c070c1f2e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.524210 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f0ff63b-2814-459d-912d-509c070c1f2e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.524998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f0ff63b-2814-459d-912d-509c070c1f2e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.525433 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f0ff63b-2814-459d-912d-509c070c1f2e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.525808 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0084b4f9-10b1-4926-80d5-f287e72f001a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1555 microversion: 2.1 time: 0.199295 May 17 22:09:58.526602 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 70/145] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:58 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1555 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:58.531337 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-38f0c13b-60e9-41e8-9680-001e8874be90 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:58.532251 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-38f0c13b-60e9-41e8-9680-001e8874be90 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:58.538996 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38f0c13b-60e9-41e8-9680-001e8874be90 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.539813 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38f0c13b-60e9-41e8-9680-001e8874be90 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.540835 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38f0c13b-60e9-41e8-9680-001e8874be90 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.541482 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38f0c13b-60e9-41e8-9680-001e8874be90 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.692878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5f0ff63b-2814-459d-912d-509c070c1f2e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.188360 May 17 22:09:58.692878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 76/146] 10.222.0.24 () {60 vars in 1315 bytes} [Tue May 17 22:09:58 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:09:58.692878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-57ab5429-65cd-4353-a9d4-de495272e319 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:58.692878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-57ab5429-65cd-4353-a9d4-de495272e319 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:58.695997 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-57ab5429-65cd-4353-a9d4-de495272e319 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.696825 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-57ab5429-65cd-4353-a9d4-de495272e319 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.697789 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-57ab5429-65cd-4353-a9d4-de495272e319 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:58.698229 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-57ab5429-65cd-4353-a9d4-de495272e319 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:58.851196 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-57ab5429-65cd-4353-a9d4-de495272e319 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164714 May 17 22:09:58.852311 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 77/147] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 17 22:09:58 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831/os-interface => generated 285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:09:58.878227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-38f0c13b-60e9-41e8-9680-001e8874be90 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:09:58.897711 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-38f0c13b-60e9-41e8-9680-001e8874be90 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.369461 May 17 22:09:58.898687 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 71/148] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:58 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:09:59.915728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8d18915b-9917-47a9-a8fb-ee3affdfbd12 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:09:59.916368 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8d18915b-9917-47a9-a8fb-ee3affdfbd12 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:09:59.922174 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d18915b-9917-47a9-a8fb-ee3affdfbd12 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:59.931487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d18915b-9917-47a9-a8fb-ee3affdfbd12 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:09:59.931487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d18915b-9917-47a9-a8fb-ee3affdfbd12 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:09:59.931487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d18915b-9917-47a9-a8fb-ee3affdfbd12 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:00.099887 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8d18915b-9917-47a9-a8fb-ee3affdfbd12 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:00.108152 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8d18915b-9917-47a9-a8fb-ee3affdfbd12 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.197003 May 17 22:10:00.118298 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 78/149] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:09:59 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:01.136977 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-be2d3c4c-16b2-4cb4-8bf4-da31698df923 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:01.138303 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-be2d3c4c-16b2-4cb4-8bf4-da31698df923 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:01.145449 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be2d3c4c-16b2-4cb4-8bf4-da31698df923 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:01.151840 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be2d3c4c-16b2-4cb4-8bf4-da31698df923 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:01.153875 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be2d3c4c-16b2-4cb4-8bf4-da31698df923 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:01.154979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be2d3c4c-16b2-4cb4-8bf4-da31698df923 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:01.330369 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-be2d3c4c-16b2-4cb4-8bf4-da31698df923 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:01.339768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-be2d3c4c-16b2-4cb4-8bf4-da31698df923 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.206811 May 17 22:10:01.340513 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 72/150] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:01 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:01.517996 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-04bd5465-2cc3-414d-a6b4-ad21d66e3474 req-4bdb8b29-04fd-4421-8128-63eef4291ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e6e64e-c18e-4856-9a95-0833c10482ee", "tag": "de95285b-0a74-427f-90f8-1b48b78cd597"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:10:01.533426 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-04bd5465-2cc3-414d-a6b4-ad21d66e3474 req-4bdb8b29-04fd-4421-8128-63eef4291ef3 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:01.533956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-04bd5465-2cc3-414d-a6b4-ad21d66e3474 req-4bdb8b29-04fd-4421-8128-63eef4291ef3 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:01.573219 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-04bd5465-2cc3-414d-a6b4-ad21d66e3474 req-4bdb8b29-04fd-4421-8128-63eef4291ef3 service nova] Creating event network-changed:de95285b-0a74-427f-90f8-1b48b78cd597 for instance 65e6e64e-c18e-4856-9a95-0833c10482ee on hv-cinder-83998 May 17 22:10:01.599028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-04bd5465-2cc3-414d-a6b4-ad21d66e3474 req-4bdb8b29-04fd-4421-8128-63eef4291ef3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090282 May 17 22:10:01.603775 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 79/151] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:10:02.356978 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-98a5289c-affd-413c-a3e0-0c9f14c9b515 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:02.358598 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-98a5289c-affd-413c-a3e0-0c9f14c9b515 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:02.394495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-98a5289c-affd-413c-a3e0-0c9f14c9b515 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:02.395319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-98a5289c-affd-413c-a3e0-0c9f14c9b515 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:02.398165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-98a5289c-affd-413c-a3e0-0c9f14c9b515 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:02.399324 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-98a5289c-affd-413c-a3e0-0c9f14c9b515 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:02.528643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-42a79d46-d078-456e-8d87-334155140289 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:02.528643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-42a79d46-d078-456e-8d87-334155140289 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:02.536169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42a79d46-d078-456e-8d87-334155140289 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:02.537067 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42a79d46-d078-456e-8d87-334155140289 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:02.538626 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42a79d46-d078-456e-8d87-334155140289 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:02.539521 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42a79d46-d078-456e-8d87-334155140289 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:02.582928 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-42a79d46-d078-456e-8d87-334155140289 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:10:02.744039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-98a5289c-affd-413c-a3e0-0c9f14c9b515 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:02.755581 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-98a5289c-affd-413c-a3e0-0c9f14c9b515 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.402765 May 17 22:10:02.756175 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 73/152] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:02 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:03.085337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-42a79d46-d078-456e-8d87-334155140289 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "DELETE /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 204 len: 0 microversion: 2.1 time: 0.559057 May 17 22:10:03.089609 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 80/153] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:10:02 2022] DELETE /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:10:03.094511 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cdc2b7dd-aa1b-4544-a5e4-a256af602ad3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:03.095245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cdc2b7dd-aa1b-4544-a5e4-a256af602ad3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:03.109871 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cdc2b7dd-aa1b-4544-a5e4-a256af602ad3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:03.110811 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cdc2b7dd-aa1b-4544-a5e4-a256af602ad3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:03.113557 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cdc2b7dd-aa1b-4544-a5e4-a256af602ad3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:03.121516 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cdc2b7dd-aa1b-4544-a5e4-a256af602ad3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:03.323058 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cdc2b7dd-aa1b-4544-a5e4-a256af602ad3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:03.332435 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-cdc2b7dd-aa1b-4544-a5e4-a256af602ad3 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1553 microversion: 2.1 time: 0.241760 May 17 22:10:03.333083 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 74/154] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:03 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:03.621340 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-99b5f5f5-927c-47bc-9443-56526f264969 req-fa32dd25-56dc-4b85-9618-bfb5e1114d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c568a7b-6b45-45c4-b60a-3514d7c43e6e", "tag": "501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e"}, {"name": "network-changed", "server_uuid": "120f12ef-0f38-41f4-a47d-2fdb6ffe8831", "tag": "6bf3020e-df21-491a-8ec0-6c8d0f806985"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:10:03.631079 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-99b5f5f5-927c-47bc-9443-56526f264969 req-fa32dd25-56dc-4b85-9618-bfb5e1114d11 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:03.631710 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-99b5f5f5-927c-47bc-9443-56526f264969 req-fa32dd25-56dc-4b85-9618-bfb5e1114d11 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:03.645222 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-99b5f5f5-927c-47bc-9443-56526f264969 req-fa32dd25-56dc-4b85-9618-bfb5e1114d11 service nova] Creating event network-changed:501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e for instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e on hv-cinder-83998 May 17 22:10:03.645812 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-99b5f5f5-927c-47bc-9443-56526f264969 req-fa32dd25-56dc-4b85-9618-bfb5e1114d11 service nova] Creating event network-changed:6bf3020e-df21-491a-8ec0-6c8d0f806985 for instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 on hv-cinder-83998 May 17 22:10:03.653293 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-99b5f5f5-927c-47bc-9443-56526f264969 req-fa32dd25-56dc-4b85-9618-bfb5e1114d11 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035856 May 17 22:10:03.654002 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 81/155] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:10:03.772975 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6819f7ee-ae69-48d2-8214-c7e4d4b98321 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:03.773625 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6819f7ee-ae69-48d2-8214-c7e4d4b98321 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:03.780201 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6819f7ee-ae69-48d2-8214-c7e4d4b98321 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:03.780646 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6819f7ee-ae69-48d2-8214-c7e4d4b98321 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:03.781416 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6819f7ee-ae69-48d2-8214-c7e4d4b98321 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:03.781844 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6819f7ee-ae69-48d2-8214-c7e4d4b98321 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:03.921337 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6819f7ee-ae69-48d2-8214-c7e4d4b98321 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:03.929529 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6819f7ee-ae69-48d2-8214-c7e4d4b98321 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.160593 May 17 22:10:03.930446 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 75/156] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:03 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:04.352773 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-56c3c09b-23d5-49dc-85de-a97b97d1b625 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:04.353453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-56c3c09b-23d5-49dc-85de-a97b97d1b625 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:04.359995 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-56c3c09b-23d5-49dc-85de-a97b97d1b625 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:04.360435 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-56c3c09b-23d5-49dc-85de-a97b97d1b625 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:04.361334 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-56c3c09b-23d5-49dc-85de-a97b97d1b625 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:04.361910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-56c3c09b-23d5-49dc-85de-a97b97d1b625 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:04.494402 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-56c3c09b-23d5-49dc-85de-a97b97d1b625 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:04.510937 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-56c3c09b-23d5-49dc-85de-a97b97d1b625 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1553 microversion: 2.1 time: 0.162928 May 17 22:10:04.522878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 82/157] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:04 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:04.948737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-39e0c1c1-52a4-4447-a44d-a11e202bbd4e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:04.949460 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-39e0c1c1-52a4-4447-a44d-a11e202bbd4e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:04.957942 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-39e0c1c1-52a4-4447-a44d-a11e202bbd4e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:04.958395 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-39e0c1c1-52a4-4447-a44d-a11e202bbd4e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:04.959244 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-39e0c1c1-52a4-4447-a44d-a11e202bbd4e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:04.960752 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-39e0c1c1-52a4-4447-a44d-a11e202bbd4e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:05.315692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-39e0c1c1-52a4-4447-a44d-a11e202bbd4e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:05.335291 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-39e0c1c1-52a4-4447-a44d-a11e202bbd4e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.387551 May 17 22:10:05.339564 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 76/158] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:04 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:05.532239 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-af95f4b4-bfb6-4f95-bd05-dd213705eebd tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:05.533822 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-af95f4b4-bfb6-4f95-bd05-dd213705eebd tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:05.542369 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-af95f4b4-bfb6-4f95-bd05-dd213705eebd tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:05.543385 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-af95f4b4-bfb6-4f95-bd05-dd213705eebd tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:05.544267 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-af95f4b4-bfb6-4f95-bd05-dd213705eebd tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:05.544709 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-af95f4b4-bfb6-4f95-bd05-dd213705eebd tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:05.772801 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-af95f4b4-bfb6-4f95-bd05-dd213705eebd tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:05.781634 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-af95f4b4-bfb6-4f95-bd05-dd213705eebd tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1553 microversion: 2.1 time: 0.255239 May 17 22:10:05.782382 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 83/159] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:05 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1553 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:06.059823 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-db4e54e6-906a-4a20-b5ef-81a1d06d2fbd req-4f2dad3a-aa66-4323-88de-ab8530d2dbba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ecc557-2ee5-4581-aace-b8de718753a6", "name": "network-vif-deleted", "tag": "4122bc49-075f-46ee-9328-771d7f9793d0"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:10:06.078998 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-db4e54e6-906a-4a20-b5ef-81a1d06d2fbd req-4f2dad3a-aa66-4323-88de-ab8530d2dbba service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:06.080497 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-db4e54e6-906a-4a20-b5ef-81a1d06d2fbd req-4f2dad3a-aa66-4323-88de-ab8530d2dbba service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:06.094639 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-db4e54e6-906a-4a20-b5ef-81a1d06d2fbd req-4f2dad3a-aa66-4323-88de-ab8530d2dbba service nova] Creating event network-vif-deleted:4122bc49-075f-46ee-9328-771d7f9793d0 for instance 58ecc557-2ee5-4581-aace-b8de718753a6 on hv-cinder-83998 May 17 22:10:06.100572 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-db4e54e6-906a-4a20-b5ef-81a1d06d2fbd req-4f2dad3a-aa66-4323-88de-ab8530d2dbba service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045140 May 17 22:10:06.105969 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 77/160] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:10:06.356537 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c672b515-2300-4318-a188-0d4176548f16 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:06.357681 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c672b515-2300-4318-a188-0d4176548f16 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:06.363965 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c672b515-2300-4318-a188-0d4176548f16 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:06.364545 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c672b515-2300-4318-a188-0d4176548f16 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:06.365473 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c672b515-2300-4318-a188-0d4176548f16 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:06.366179 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c672b515-2300-4318-a188-0d4176548f16 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:06.545392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c672b515-2300-4318-a188-0d4176548f16 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:06.553620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c672b515-2300-4318-a188-0d4176548f16 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.201030 May 17 22:10:06.563013 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 84/161] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:06 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:06.800072 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f994de6f-c57e-46ac-b58b-00f2c692e784 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:06.800905 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f994de6f-c57e-46ac-b58b-00f2c692e784 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:06.808635 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f994de6f-c57e-46ac-b58b-00f2c692e784 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:06.809341 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f994de6f-c57e-46ac-b58b-00f2c692e784 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:06.810119 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f994de6f-c57e-46ac-b58b-00f2c692e784 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:06.810547 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f994de6f-c57e-46ac-b58b-00f2c692e784 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:06.888850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f994de6f-c57e-46ac-b58b-00f2c692e784 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35ef7a36ac424aa995c44c9eb90bd1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d2df1e983894585869358afcafd0fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:06.898310 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f994de6f-c57e-46ac-b58b-00f2c692e784 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 200 len: 1346 microversion: 2.1 time: 0.102278 May 17 22:10:06.898674 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 78/162] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:06 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 1346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:07.571265 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-50cb58ce-f143-4c88-9cf3-37ef721a15f9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:07.571879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-50cb58ce-f143-4c88-9cf3-37ef721a15f9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:07.577974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50cb58ce-f143-4c88-9cf3-37ef721a15f9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:07.581208 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50cb58ce-f143-4c88-9cf3-37ef721a15f9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:07.581208 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50cb58ce-f143-4c88-9cf3-37ef721a15f9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:07.581208 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50cb58ce-f143-4c88-9cf3-37ef721a15f9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:07.731717 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-50cb58ce-f143-4c88-9cf3-37ef721a15f9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:07.739235 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-50cb58ce-f143-4c88-9cf3-37ef721a15f9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.172705 May 17 22:10:07.739790 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 85/163] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:07 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:07.915573 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0664ca49-ec5a-4176-a7df-5007c773c498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:07.916173 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0664ca49-ec5a-4176-a7df-5007c773c498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:07.922329 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0664ca49-ec5a-4176-a7df-5007c773c498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:07.922773 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0664ca49-ec5a-4176-a7df-5007c773c498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:07.923558 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0664ca49-ec5a-4176-a7df-5007c773c498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:07.923984 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0664ca49-ec5a-4176-a7df-5007c773c498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:07.940097 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-0664ca49-ec5a-4176-a7df-5007c773c498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] HTTP exception thrown: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0664ca49-ec5a-4176-a7df-5007c773c498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Request method failure captured: May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 HTTP/1.1 May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihBz5YPpRh4362QnP7UEVu7A6pv9ba7brtHyCcMtLtx4pk76QxZUYy_i-nchzoXkspZoQ7mGJoeRGtnCcXlIwaJLa4JN-mIsYiCEGGh8uPqEpQ-WbuZexYMkvvQm7_Vi2zm7vAvFs9Iu1PpSRIAmgWZtRAptBibJtuJ06VxxS8zrXrCk May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 0d2df1e983894585869358afcafd0fb5 May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-DeleteServersTestJSON-1491617826 May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:10:07.947200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:10:07.948683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0d2df1e983894585869358afcafd0fb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_0d2df1e983894585869358afcafd0fb5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/0d2df1e983894585869358afcafd0fb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0d2df1e983894585869358afcafd0fb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:10:07.948683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-DeleteServersTestJSON-1491617826 May 17 22:10:07.948683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 0d2df1e983894585869358afcafd0fb5 May 17 22:10:07.948683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-DeleteServersTestJSON-1491617826 May 17 22:10:07.948683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-DeleteServersTestJSON-1491617826-project May 17 22:10:07.948683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:10:07.948683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:10:07.948683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 35ef7a36ac424aa995c44c9eb90bd1d6 May 17 22:10:07.948683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-DeleteServersTestJSON-1491617826-project May 17 22:10:07.948683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:10:07.948683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:07.948683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '58ecc557-2ee5-4581-aace-b8de718753a6'} May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:10:07.949743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:07.951087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:07.952368 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0664ca49-ec5a-4176-a7df-5007c773c498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Returning 404 to user: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:10:07.952368 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0664ca49-ec5a-4176-a7df-5007c773c498 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 404 len: 111 microversion: 2.1 time: 0.037826 May 17 22:10:07.952368 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 79/164] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:07 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:10:08.304061 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a5f2a90e-5e71-4eae-9440-b06c475aa75c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:08.305011 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a5f2a90e-5e71-4eae-9440-b06c475aa75c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:08.311349 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5f2a90e-5e71-4eae-9440-b06c475aa75c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:08.311798 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5f2a90e-5e71-4eae-9440-b06c475aa75c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:08.312561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5f2a90e-5e71-4eae-9440-b06c475aa75c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:08.312994 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5f2a90e-5e71-4eae-9440-b06c475aa75c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:08.329097 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-a5f2a90e-5e71-4eae-9440-b06c475aa75c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] HTTP exception thrown: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a5f2a90e-5e71-4eae-9440-b06c475aa75c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Request method failure captured: May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6/os-volume_attachments HTTP/1.1 May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihBz5YPpRh4362QnP7UEVu7A6pv9ba7brtHyCcMtLtx4pk76QxZUYy_i-nchzoXkspZoQ7mGJoeRGtnCcXlIwaJLa4JN-mIsYiCEGGh8uPqEpQ-WbuZexYMkvvQm7_Vi2zm7vAvFs9Iu1PpSRIAmgWZtRAptBibJtuJ06VxxS8zrXrCk May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 0d2df1e983894585869358afcafd0fb5 May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-DeleteServersTestJSON-1491617826 May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:10:08.339633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:10:08.341094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0d2df1e983894585869358afcafd0fb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_0d2df1e983894585869358afcafd0fb5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/0d2df1e983894585869358afcafd0fb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0d2df1e983894585869358afcafd0fb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:10:08.341094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-DeleteServersTestJSON-1491617826 May 17 22:10:08.341094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 0d2df1e983894585869358afcafd0fb5 May 17 22:10:08.341094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1491617826 May 17 22:10:08.341094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-DeleteServersTestJSON-1491617826-project May 17 22:10:08.341094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:10:08.341094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:10:08.341094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 35ef7a36ac424aa995c44c9eb90bd1d6 May 17 22:10:08.341094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-DeleteServersTestJSON-1491617826-project May 17 22:10:08.341094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:10:08.341094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:08.341094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'server_id': '58ecc557-2ee5-4581-aace-b8de718753a6'} May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:10:08.341874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:08.343212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:08.344269 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a5f2a90e-5e71-4eae-9440-b06c475aa75c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Returning 404 to user: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:10:08.344269 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a5f2a90e-5e71-4eae-9440-b06c475aa75c tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041203 May 17 22:10:08.344269 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 86/165] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:10:08 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:10:08.758130 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-38630bf3-c918-4e2e-9e14-8f7f4a1adf76 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:08.758794 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-38630bf3-c918-4e2e-9e14-8f7f4a1adf76 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:08.767799 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38630bf3-c918-4e2e-9e14-8f7f4a1adf76 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:08.768349 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38630bf3-c918-4e2e-9e14-8f7f4a1adf76 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:08.774579 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38630bf3-c918-4e2e-9e14-8f7f4a1adf76 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:08.774579 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38630bf3-c918-4e2e-9e14-8f7f4a1adf76 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:08.928578 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-38630bf3-c918-4e2e-9e14-8f7f4a1adf76 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:08.937502 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-38630bf3-c918-4e2e-9e14-8f7f4a1adf76 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.183974 May 17 22:10:08.938079 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 80/166] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:08 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:09.885955 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7d74607c-455d-4436-b448-f12a2e760daa tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:09.886481 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7d74607c-455d-4436-b448-f12a2e760daa tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:09.892559 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d74607c-455d-4436-b448-f12a2e760daa tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:09.893025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d74607c-455d-4436-b448-f12a2e760daa tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:09.893825 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d74607c-455d-4436-b448-f12a2e760daa tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:09.894218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d74607c-455d-4436-b448-f12a2e760daa tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:09.908339 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-7d74607c-455d-4436-b448-f12a2e760daa tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] HTTP exception thrown: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7d74607c-455d-4436-b448-f12a2e760daa tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Request method failure captured: May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: DELETE /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 HTTP/1.1 May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihBz5YPpRh4362QnP7UEVu7A6pv9ba7brtHyCcMtLtx4pk76QxZUYy_i-nchzoXkspZoQ7mGJoeRGtnCcXlIwaJLa4JN-mIsYiCEGGh8uPqEpQ-WbuZexYMkvvQm7_Vi2zm7vAvFs9Iu1PpSRIAmgWZtRAptBibJtuJ06VxxS8zrXrCk May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 0d2df1e983894585869358afcafd0fb5 May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-DeleteServersTestJSON-1491617826 May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:10:09.910492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:10:09.911991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0d2df1e983894585869358afcafd0fb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_0d2df1e983894585869358afcafd0fb5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/0d2df1e983894585869358afcafd0fb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0d2df1e983894585869358afcafd0fb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:10:09.911991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-DeleteServersTestJSON-1491617826 May 17 22:10:09.911991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 0d2df1e983894585869358afcafd0fb5 May 17 22:10:09.911991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1491617826 May 17 22:10:09.911991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-DeleteServersTestJSON-1491617826-project May 17 22:10:09.911991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:10:09.911991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:10:09.911991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 35ef7a36ac424aa995c44c9eb90bd1d6 May 17 22:10:09.911991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-DeleteServersTestJSON-1491617826-project May 17 22:10:09.911991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:10:09.911991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:09.911991 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '58ecc557-2ee5-4581-aace-b8de718753a6'} May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:10:09.915650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:09.916916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:09.918441 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7d74607c-455d-4436-b448-f12a2e760daa tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Returning 404 to user: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:10:09.918441 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7d74607c-455d-4436-b448-f12a2e760daa tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "DELETE /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 404 len: 111 microversion: 2.1 time: 0.030620 May 17 22:10:09.918441 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 87/167] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:10:09 2022] DELETE /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:10:09.923162 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-41a87491-f09c-4f8f-be30-5de2ea577367 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:09.923805 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-41a87491-f09c-4f8f-be30-5de2ea577367 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] [instance: 58ecc557-2ee5-4581-aace-b8de718753a6] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:09.931384 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41a87491-f09c-4f8f-be30-5de2ea577367 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:09.932072 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41a87491-f09c-4f8f-be30-5de2ea577367 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:09.932589 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41a87491-f09c-4f8f-be30-5de2ea577367 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:09.933022 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41a87491-f09c-4f8f-be30-5de2ea577367 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:09.948094 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-41a87491-f09c-4f8f-be30-5de2ea577367 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] HTTP exception thrown: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-41a87491-f09c-4f8f-be30-5de2ea577367 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Request method failure captured: May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 HTTP/1.1 May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihBz5YPpRh4362QnP7UEVu7A6pv9ba7brtHyCcMtLtx4pk76QxZUYy_i-nchzoXkspZoQ7mGJoeRGtnCcXlIwaJLa4JN-mIsYiCEGGh8uPqEpQ-WbuZexYMkvvQm7_Vi2zm7vAvFs9Iu1PpSRIAmgWZtRAptBibJtuJ06VxxS8zrXrCk May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 0d2df1e983894585869358afcafd0fb5 May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-DeleteServersTestJSON-1491617826 May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:10:09.949614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:10:09.954556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0d2df1e983894585869358afcafd0fb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_0d2df1e983894585869358afcafd0fb5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/0d2df1e983894585869358afcafd0fb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/0d2df1e983894585869358afcafd0fb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:10:09.954556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-DeleteServersTestJSON-1491617826 May 17 22:10:09.954556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 0d2df1e983894585869358afcafd0fb5 May 17 22:10:09.954556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-DeleteServersTestJSON-1491617826 May 17 22:10:09.954556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-DeleteServersTestJSON-1491617826-project May 17 22:10:09.954556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:10:09.954556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:10:09.954556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 35ef7a36ac424aa995c44c9eb90bd1d6 May 17 22:10:09.954556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-DeleteServersTestJSON-1491617826-project May 17 22:10:09.954556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:10:09.954556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:09.954556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '58ecc557-2ee5-4581-aace-b8de718753a6'} May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:10:09.955253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. May 17 22:10:09.956832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:09.957814 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-41a87491-f09c-4f8f-be30-5de2ea577367 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] Returning 404 to user: Instance 58ecc557-2ee5-4581-aace-b8de718753a6 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:10:09.957814 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-41a87491-f09c-4f8f-be30-5de2ea577367 tempest-DeleteServersTestJSON-1491617826 tempest-DeleteServersTestJSON-1491617826-project] 10.222.0.24 "GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6" status: 404 len: 111 microversion: 2.1 time: 0.034172 May 17 22:10:09.957814 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 81/168] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:09 2022] GET /compute/v2.1/servers/58ecc557-2ee5-4581-aace-b8de718753a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 22:10:09.958003 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2809e237-401a-4455-beda-44043e4e42db tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:09.958003 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2809e237-401a-4455-beda-44043e4e42db tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:09.963604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2809e237-401a-4455-beda-44043e4e42db tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:09.964051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2809e237-401a-4455-beda-44043e4e42db tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:09.964821 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2809e237-401a-4455-beda-44043e4e42db tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:09.965247 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2809e237-401a-4455-beda-44043e4e42db tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:10.102335 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2809e237-401a-4455-beda-44043e4e42db tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:10.110179 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2809e237-401a-4455-beda-44043e4e42db tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.158620 May 17 22:10:10.110883 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 88/169] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:09 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:10:11.127229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e71ca0e4-aac4-44b2-903a-d9f7baa05efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:11.127839 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e71ca0e4-aac4-44b2-903a-d9f7baa05efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:11.135496 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e71ca0e4-aac4-44b2-903a-d9f7baa05efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:11.136192 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e71ca0e4-aac4-44b2-903a-d9f7baa05efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:11.137134 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e71ca0e4-aac4-44b2-903a-d9f7baa05efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:11.137569 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e71ca0e4-aac4-44b2-903a-d9f7baa05efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:11.328705 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e71ca0e4-aac4-44b2-903a-d9f7baa05efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:11.336481 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e71ca0e4-aac4-44b2-903a-d9f7baa05efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.213196 May 17 22:10:11.337044 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 82/170] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:11 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:11.664606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1387993130", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:10:11.714301 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] validate_networks() for None {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:10:12.012660 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:10:12.013092 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:10:12.013584 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:10:12.013995 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:10:12.014405 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:10:12.025571 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:12.026017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:12.026816 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:12.039431 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:12.044886 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Getting quotas for project 53795e38f3b84b859ad65f6203156d20. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:10:12.048797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Getting quotas for user 0fc61ff90d7041968220543a037ddf3a and project 53795e38f3b84b859ad65f6203156d20. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:10:12.059977 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:10:12.062230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:10:12.229397 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-94f1611f-1923-41b1-9e9c-a4674c3d3b4c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569017 May 17 22:10:12.231485 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 89/171] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:10:12.244065 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a0a35eb8-fa2e-4b69-998a-8ebb77a18191 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:12.244672 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a0a35eb8-fa2e-4b69-998a-8ebb77a18191 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:12.317266 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a0a35eb8-fa2e-4b69-998a-8ebb77a18191 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:12.331904 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a0a35eb8-fa2e-4b69-998a-8ebb77a18191 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1215 microversion: 2.1 time: 0.084687 May 17 22:10:12.331904 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 83/172] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:12 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:12.354253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-427b268a-28a2-4489-9db1-4f2547112b99 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:12.361408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-427b268a-28a2-4489-9db1-4f2547112b99 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:12.362121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-427b268a-28a2-4489-9db1-4f2547112b99 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:12.362702 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-427b268a-28a2-4489-9db1-4f2547112b99 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:12.363525 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-427b268a-28a2-4489-9db1-4f2547112b99 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:12.363992 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-427b268a-28a2-4489-9db1-4f2547112b99 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:12.509442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-427b268a-28a2-4489-9db1-4f2547112b99 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:12.516656 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-427b268a-28a2-4489-9db1-4f2547112b99 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.167467 May 17 22:10:12.517208 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 90/173] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:12 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:13.346863 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-80f8b94c-63e6-45d4-b337-1be33af9a8e0 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:13.347614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-80f8b94c-63e6-45d4-b337-1be33af9a8e0 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:13.404524 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-80f8b94c-63e6-45d4-b337-1be33af9a8e0 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:13.411587 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-80f8b94c-63e6-45d4-b337-1be33af9a8e0 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1215 microversion: 2.1 time: 0.068520 May 17 22:10:13.412374 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 84/174] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:13 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:13.534143 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6fdda17f-5016-49a4-afc4-a15224052599 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:13.534865 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6fdda17f-5016-49a4-afc4-a15224052599 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:13.541359 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6fdda17f-5016-49a4-afc4-a15224052599 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:13.542059 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6fdda17f-5016-49a4-afc4-a15224052599 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:13.543253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6fdda17f-5016-49a4-afc4-a15224052599 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:13.543880 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6fdda17f-5016-49a4-afc4-a15224052599 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:13.698141 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6fdda17f-5016-49a4-afc4-a15224052599 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:13.708480 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6fdda17f-5016-49a4-afc4-a15224052599 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.178468 May 17 22:10:13.712769 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 91/175] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:13 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:14.430680 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ddf4b8d7-f9ea-438b-a55f-695d9c2b4a50 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:14.431330 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ddf4b8d7-f9ea-438b-a55f-695d9c2b4a50 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:14.444501 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ddf4b8d7-f9ea-438b-a55f-695d9c2b4a50 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:14.445017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ddf4b8d7-f9ea-438b-a55f-695d9c2b4a50 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:14.445926 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ddf4b8d7-f9ea-438b-a55f-695d9c2b4a50 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:14.446617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ddf4b8d7-f9ea-438b-a55f-695d9c2b4a50 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:14.525202 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ddf4b8d7-f9ea-438b-a55f-695d9c2b4a50 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:14.534538 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ddf4b8d7-f9ea-438b-a55f-695d9c2b4a50 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1267 microversion: 2.1 time: 0.108291 May 17 22:10:14.535807 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 85/176] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:14 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:14.731278 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bc964f66-035a-4311-ba6f-086be1a63ee5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:14.732150 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bc964f66-035a-4311-ba6f-086be1a63ee5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:14.738508 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bc964f66-035a-4311-ba6f-086be1a63ee5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:14.739457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bc964f66-035a-4311-ba6f-086be1a63ee5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:14.741579 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bc964f66-035a-4311-ba6f-086be1a63ee5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:14.741933 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bc964f66-035a-4311-ba6f-086be1a63ee5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:14.977779 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bc964f66-035a-4311-ba6f-086be1a63ee5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:14.985129 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bc964f66-035a-4311-ba6f-086be1a63ee5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.258322 May 17 22:10:14.985703 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 92/177] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:14 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:15.554373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c770e7b6-6202-42a2-841b-bca9a28f4917 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:15.555084 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c770e7b6-6202-42a2-841b-bca9a28f4917 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:15.562216 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c770e7b6-6202-42a2-841b-bca9a28f4917 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:15.562753 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c770e7b6-6202-42a2-841b-bca9a28f4917 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:15.563652 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c770e7b6-6202-42a2-841b-bca9a28f4917 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:15.564191 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c770e7b6-6202-42a2-841b-bca9a28f4917 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:15.658468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c770e7b6-6202-42a2-841b-bca9a28f4917 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:15.666841 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c770e7b6-6202-42a2-841b-bca9a28f4917 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1273 microversion: 2.1 time: 0.117121 May 17 22:10:15.668021 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 86/178] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:15 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:16.006946 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-40dcae54-fc5b-4888-ac1e-504d73e7f172 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:16.007680 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-40dcae54-fc5b-4888-ac1e-504d73e7f172 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:16.014337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-40dcae54-fc5b-4888-ac1e-504d73e7f172 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:16.014952 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-40dcae54-fc5b-4888-ac1e-504d73e7f172 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:16.015866 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-40dcae54-fc5b-4888-ac1e-504d73e7f172 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:16.016548 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-40dcae54-fc5b-4888-ac1e-504d73e7f172 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:16.560523 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-40dcae54-fc5b-4888-ac1e-504d73e7f172 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:16.570736 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-40dcae54-fc5b-4888-ac1e-504d73e7f172 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.572568 May 17 22:10:16.582572 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 93/179] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:15 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:16.691291 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b16b0503-f3d1-42b6-a354-f0bcfc1c10a6 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:16.692428 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b16b0503-f3d1-42b6-a354-f0bcfc1c10a6 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:16.704695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b16b0503-f3d1-42b6-a354-f0bcfc1c10a6 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:16.706011 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b16b0503-f3d1-42b6-a354-f0bcfc1c10a6 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:16.707756 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b16b0503-f3d1-42b6-a354-f0bcfc1c10a6 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:16.709397 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b16b0503-f3d1-42b6-a354-f0bcfc1c10a6 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:16.957726 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b16b0503-f3d1-42b6-a354-f0bcfc1c10a6 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:16.988932 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b16b0503-f3d1-42b6-a354-f0bcfc1c10a6 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1315 microversion: 2.1 time: 0.304852 May 17 22:10:16.990820 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 87/180] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:16 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:10:17.419695 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-1d1c2af8-0d6d-4ef7-83e7-44322b213d99 req-0132f91b-c063-453a-8985-4612ae561f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df663c37-787c-4720-be26-9e1456eb7c9a", "tag": "f93bcb80-75a6-42b1-8212-a886f6acc352"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:10:17.422804 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-1d1c2af8-0d6d-4ef7-83e7-44322b213d99 req-0132f91b-c063-453a-8985-4612ae561f02 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:17.423413 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-1d1c2af8-0d6d-4ef7-83e7-44322b213d99 req-0132f91b-c063-453a-8985-4612ae561f02 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:17.437174 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-1d1c2af8-0d6d-4ef7-83e7-44322b213d99 req-0132f91b-c063-453a-8985-4612ae561f02 service nova] Creating event network-changed:f93bcb80-75a6-42b1-8212-a886f6acc352 for instance df663c37-787c-4720-be26-9e1456eb7c9a on hv-cinder-83998 May 17 22:10:17.445014 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-1d1c2af8-0d6d-4ef7-83e7-44322b213d99 req-0132f91b-c063-453a-8985-4612ae561f02 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035249 May 17 22:10:17.447777 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 94/181] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:10:17.590193 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e28e0c92-ff1f-48ed-86fb-2dca11eb02dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:17.591048 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e28e0c92-ff1f-48ed-86fb-2dca11eb02dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:17.599275 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e28e0c92-ff1f-48ed-86fb-2dca11eb02dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:17.599766 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e28e0c92-ff1f-48ed-86fb-2dca11eb02dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:17.600705 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e28e0c92-ff1f-48ed-86fb-2dca11eb02dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:17.601429 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e28e0c92-ff1f-48ed-86fb-2dca11eb02dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:17.793726 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e28e0c92-ff1f-48ed-86fb-2dca11eb02dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:17.803326 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e28e0c92-ff1f-48ed-86fb-2dca11eb02dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.216805 May 17 22:10:17.804436 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 88/182] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:17 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:18.013656 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2e321ee9-813b-440e-b122-1bb96582ba0f tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:18.014706 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2e321ee9-813b-440e-b122-1bb96582ba0f tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:18.023765 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2e321ee9-813b-440e-b122-1bb96582ba0f tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:18.024674 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2e321ee9-813b-440e-b122-1bb96582ba0f tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:18.026006 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2e321ee9-813b-440e-b122-1bb96582ba0f tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:18.027151 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2e321ee9-813b-440e-b122-1bb96582ba0f tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:18.269250 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2e321ee9-813b-440e-b122-1bb96582ba0f tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:18.278058 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2e321ee9-813b-440e-b122-1bb96582ba0f tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1315 microversion: 2.1 time: 0.272408 May 17 22:10:18.278633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 95/183] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:18 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:18.822335 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d653d7dc-40ce-42c6-ad16-f1c2f0bb782e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:18.822948 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d653d7dc-40ce-42c6-ad16-f1c2f0bb782e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:18.829256 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d653d7dc-40ce-42c6-ad16-f1c2f0bb782e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:18.829703 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d653d7dc-40ce-42c6-ad16-f1c2f0bb782e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:18.830471 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d653d7dc-40ce-42c6-ad16-f1c2f0bb782e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:18.830904 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d653d7dc-40ce-42c6-ad16-f1c2f0bb782e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:18.982661 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d653d7dc-40ce-42c6-ad16-f1c2f0bb782e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:18.989904 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d653d7dc-40ce-42c6-ad16-f1c2f0bb782e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.172579 May 17 22:10:18.990465 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 89/184] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:18 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:19.296123 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-be418af3-9ef6-48c5-8e9d-4b3f0462f95b tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:19.296722 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-be418af3-9ef6-48c5-8e9d-4b3f0462f95b tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:19.302543 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be418af3-9ef6-48c5-8e9d-4b3f0462f95b tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:19.302865 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be418af3-9ef6-48c5-8e9d-4b3f0462f95b tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:19.303641 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be418af3-9ef6-48c5-8e9d-4b3f0462f95b tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:19.304109 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be418af3-9ef6-48c5-8e9d-4b3f0462f95b tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:19.446255 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-be418af3-9ef6-48c5-8e9d-4b3f0462f95b tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:19.453768 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-be418af3-9ef6-48c5-8e9d-4b3f0462f95b tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1315 microversion: 2.1 time: 0.161454 May 17 22:10:19.454538 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 96/185] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:19 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:10:20.008070 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e3235b85-9fbb-48ff-8061-9c51ea022efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:20.008601 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e3235b85-9fbb-48ff-8061-9c51ea022efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:20.014892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e3235b85-9fbb-48ff-8061-9c51ea022efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:20.015374 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e3235b85-9fbb-48ff-8061-9c51ea022efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:20.016145 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e3235b85-9fbb-48ff-8061-9c51ea022efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:20.018875 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e3235b85-9fbb-48ff-8061-9c51ea022efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:20.155319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e3235b85-9fbb-48ff-8061-9c51ea022efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:20.162764 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e3235b85-9fbb-48ff-8061-9c51ea022efa tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.158768 May 17 22:10:20.164073 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 90/186] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:20 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:20.471278 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-88cba1e3-f8b5-4f42-ac8c-69c07b05f64c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:20.471884 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-88cba1e3-f8b5-4f42-ac8c-69c07b05f64c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:20.478494 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-88cba1e3-f8b5-4f42-ac8c-69c07b05f64c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:20.478969 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-88cba1e3-f8b5-4f42-ac8c-69c07b05f64c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:20.479798 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-88cba1e3-f8b5-4f42-ac8c-69c07b05f64c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:20.480238 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-88cba1e3-f8b5-4f42-ac8c-69c07b05f64c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:20.637147 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-88cba1e3-f8b5-4f42-ac8c-69c07b05f64c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:20.644492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-88cba1e3-f8b5-4f42-ac8c-69c07b05f64c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1315 microversion: 2.1 time: 0.177230 May 17 22:10:20.645064 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 97/187] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:20 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:21.180546 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-61e5fe87-a529-4b51-9d77-3f804a1b22cc tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:21.181187 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-61e5fe87-a529-4b51-9d77-3f804a1b22cc tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:21.188163 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61e5fe87-a529-4b51-9d77-3f804a1b22cc tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:21.188696 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61e5fe87-a529-4b51-9d77-3f804a1b22cc tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:21.189498 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61e5fe87-a529-4b51-9d77-3f804a1b22cc tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:21.189936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61e5fe87-a529-4b51-9d77-3f804a1b22cc tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:21.323963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-61e5fe87-a529-4b51-9d77-3f804a1b22cc tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:21.342584 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-61e5fe87-a529-4b51-9d77-3f804a1b22cc tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.165916 May 17 22:10:21.352769 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 91/188] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:21 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:21.662876 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3f309136-2858-4282-98c8-0f4a5ec236da tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:21.663656 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3f309136-2858-4282-98c8-0f4a5ec236da tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:21.669469 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3f309136-2858-4282-98c8-0f4a5ec236da tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:21.670767 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3f309136-2858-4282-98c8-0f4a5ec236da tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:21.670767 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3f309136-2858-4282-98c8-0f4a5ec236da tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:21.671071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3f309136-2858-4282-98c8-0f4a5ec236da tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:21.808011 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3f309136-2858-4282-98c8-0f4a5ec236da tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:21.815675 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3f309136-2858-4282-98c8-0f4a5ec236da tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1315 microversion: 2.1 time: 0.156578 May 17 22:10:21.816247 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 98/189] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:21 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:22.360324 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-225d0ae0-8734-4fe8-862f-e0af2c84d701 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:22.360940 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-225d0ae0-8734-4fe8-862f-e0af2c84d701 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:22.368260 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-225d0ae0-8734-4fe8-862f-e0af2c84d701 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:22.368712 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-225d0ae0-8734-4fe8-862f-e0af2c84d701 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:22.369655 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-225d0ae0-8734-4fe8-862f-e0af2c84d701 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:22.370105 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-225d0ae0-8734-4fe8-862f-e0af2c84d701 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:22.500887 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-225d0ae0-8734-4fe8-862f-e0af2c84d701 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:22.510549 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-225d0ae0-8734-4fe8-862f-e0af2c84d701 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.154117 May 17 22:10:22.511161 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 92/190] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:22 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:22.833040 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c01fb097-23dd-450b-8586-c6431c5f7e88 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:22.833640 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c01fb097-23dd-450b-8586-c6431c5f7e88 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:22.840251 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c01fb097-23dd-450b-8586-c6431c5f7e88 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:22.840700 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c01fb097-23dd-450b-8586-c6431c5f7e88 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:22.841475 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c01fb097-23dd-450b-8586-c6431c5f7e88 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:22.841910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c01fb097-23dd-450b-8586-c6431c5f7e88 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:23.040326 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c01fb097-23dd-450b-8586-c6431c5f7e88 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:23.047476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c01fb097-23dd-450b-8586-c6431c5f7e88 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1315 microversion: 2.1 time: 0.218244 May 17 22:10:23.048036 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 99/191] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:22 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:23.459552 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-41809434-fd01-482c-86e7-17031f21fe06 req-707d30b5-dc79-41a4-b133-a91dc32051d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df663c37-787c-4720-be26-9e1456eb7c9a", "name": "network-vif-plugged", "status": "completed", "tag": "f93bcb80-75a6-42b1-8212-a886f6acc352"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:10:23.469540 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-41809434-fd01-482c-86e7-17031f21fe06 req-707d30b5-dc79-41a4-b133-a91dc32051d6 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:23.470171 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-41809434-fd01-482c-86e7-17031f21fe06 req-707d30b5-dc79-41a4-b133-a91dc32051d6 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:23.484559 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-41809434-fd01-482c-86e7-17031f21fe06 req-707d30b5-dc79-41a4-b133-a91dc32051d6 service nova] Creating event network-vif-plugged:f93bcb80-75a6-42b1-8212-a886f6acc352 for instance df663c37-787c-4720-be26-9e1456eb7c9a on hv-cinder-83998 May 17 22:10:23.490408 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-41809434-fd01-482c-86e7-17031f21fe06 req-707d30b5-dc79-41a4-b133-a91dc32051d6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034431 May 17 22:10:23.491574 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 93/192] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:10:23.537337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4931a000-9fc3-4f74-9175-c590e373639c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:23.539277 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4931a000-9fc3-4f74-9175-c590e373639c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:23.549334 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4931a000-9fc3-4f74-9175-c590e373639c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:23.550052 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4931a000-9fc3-4f74-9175-c590e373639c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:23.550857 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4931a000-9fc3-4f74-9175-c590e373639c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:23.551313 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4931a000-9fc3-4f74-9175-c590e373639c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:23.712723 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4931a000-9fc3-4f74-9175-c590e373639c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:23.720434 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4931a000-9fc3-4f74-9175-c590e373639c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.186791 May 17 22:10:23.721198 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 100/193] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:23 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:24.065163 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9a8355ca-f971-44f7-8e3e-5ad04e6ae7db tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:24.068429 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9a8355ca-f971-44f7-8e3e-5ad04e6ae7db tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:24.072229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a8355ca-f971-44f7-8e3e-5ad04e6ae7db tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:24.072670 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a8355ca-f971-44f7-8e3e-5ad04e6ae7db tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:24.073429 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a8355ca-f971-44f7-8e3e-5ad04e6ae7db tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:24.073856 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a8355ca-f971-44f7-8e3e-5ad04e6ae7db tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:24.206448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9a8355ca-f971-44f7-8e3e-5ad04e6ae7db tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:24.214502 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9a8355ca-f971-44f7-8e3e-5ad04e6ae7db tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1315 microversion: 2.1 time: 0.153541 May 17 22:10:24.215067 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 94/194] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:24 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:24.738011 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5d6712dc-27ba-4092-9b14-2349fd345939 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:24.738606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5d6712dc-27ba-4092-9b14-2349fd345939 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:24.744580 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d6712dc-27ba-4092-9b14-2349fd345939 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:24.745013 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d6712dc-27ba-4092-9b14-2349fd345939 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:24.745777 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d6712dc-27ba-4092-9b14-2349fd345939 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:24.746201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d6712dc-27ba-4092-9b14-2349fd345939 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:24.875806 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5d6712dc-27ba-4092-9b14-2349fd345939 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:24.883293 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5d6712dc-27ba-4092-9b14-2349fd345939 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.149037 May 17 22:10:24.883858 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 101/195] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:24 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:25.232172 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-364c03af-e904-4e33-b799-1d8f0ae956de tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:25.232778 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-364c03af-e904-4e33-b799-1d8f0ae956de tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:25.239224 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-364c03af-e904-4e33-b799-1d8f0ae956de tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:25.239667 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-364c03af-e904-4e33-b799-1d8f0ae956de tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:25.240628 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-364c03af-e904-4e33-b799-1d8f0ae956de tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:25.241058 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-364c03af-e904-4e33-b799-1d8f0ae956de tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:25.377321 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-364c03af-e904-4e33-b799-1d8f0ae956de tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:25.385562 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-364c03af-e904-4e33-b799-1d8f0ae956de tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1315 microversion: 2.1 time: 0.157109 May 17 22:10:25.386147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 95/196] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:25 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:10:25.899683 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0de4d765-b63e-47b6-a24e-6911e2579ea1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:25.900289 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0de4d765-b63e-47b6-a24e-6911e2579ea1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:25.906467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0de4d765-b63e-47b6-a24e-6911e2579ea1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:25.906940 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0de4d765-b63e-47b6-a24e-6911e2579ea1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:25.907740 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0de4d765-b63e-47b6-a24e-6911e2579ea1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:25.908183 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0de4d765-b63e-47b6-a24e-6911e2579ea1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:26.034576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0de4d765-b63e-47b6-a24e-6911e2579ea1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:26.042703 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0de4d765-b63e-47b6-a24e-6911e2579ea1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.146911 May 17 22:10:26.043571 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 102/197] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:25 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:26.403864 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef82fcf3-e319-4093-b40e-c695fdd1a334 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:26.404420 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ef82fcf3-e319-4093-b40e-c695fdd1a334 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:26.410681 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef82fcf3-e319-4093-b40e-c695fdd1a334 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:26.411147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef82fcf3-e319-4093-b40e-c695fdd1a334 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:26.411907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef82fcf3-e319-4093-b40e-c695fdd1a334 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:26.414124 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef82fcf3-e319-4093-b40e-c695fdd1a334 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:26.544853 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef82fcf3-e319-4093-b40e-c695fdd1a334 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:26.552031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ef82fcf3-e319-4093-b40e-c695fdd1a334 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1315 microversion: 2.1 time: 0.152135 May 17 22:10:26.552587 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 96/198] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:26 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:27.060103 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-96cfea15-10cb-46bf-9b70-dbd34efe5e01 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:27.060703 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-96cfea15-10cb-46bf-9b70-dbd34efe5e01 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:27.066473 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-96cfea15-10cb-46bf-9b70-dbd34efe5e01 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:27.066912 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-96cfea15-10cb-46bf-9b70-dbd34efe5e01 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:27.067698 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-96cfea15-10cb-46bf-9b70-dbd34efe5e01 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:27.068119 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-96cfea15-10cb-46bf-9b70-dbd34efe5e01 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:27.193062 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-96cfea15-10cb-46bf-9b70-dbd34efe5e01 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:27.200477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-96cfea15-10cb-46bf-9b70-dbd34efe5e01 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.144381 May 17 22:10:27.201056 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 103/199] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:27 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:27.569125 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-93a60dc2-1db6-4afa-afd4-d591f6d3e592 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:27.569635 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-93a60dc2-1db6-4afa-afd4-d591f6d3e592 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:27.575993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93a60dc2-1db6-4afa-afd4-d591f6d3e592 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:27.576440 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93a60dc2-1db6-4afa-afd4-d591f6d3e592 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:27.577203 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93a60dc2-1db6-4afa-afd4-d591f6d3e592 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:27.577634 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93a60dc2-1db6-4afa-afd4-d591f6d3e592 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:27.706217 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-93a60dc2-1db6-4afa-afd4-d591f6d3e592 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:27.715778 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-93a60dc2-1db6-4afa-afd4-d591f6d3e592 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1315 microversion: 2.1 time: 0.150498 May 17 22:10:27.716366 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 97/200] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:27 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:28.216919 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5e86e761-6b8c-47c0-8398-43799e9478e9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:28.217630 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5e86e761-6b8c-47c0-8398-43799e9478e9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:28.224019 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e86e761-6b8c-47c0-8398-43799e9478e9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:28.224572 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e86e761-6b8c-47c0-8398-43799e9478e9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:28.225403 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e86e761-6b8c-47c0-8398-43799e9478e9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:28.226461 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e86e761-6b8c-47c0-8398-43799e9478e9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:28.356505 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5e86e761-6b8c-47c0-8398-43799e9478e9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:28.363756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5e86e761-6b8c-47c0-8398-43799e9478e9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.150894 May 17 22:10:28.364323 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 104/201] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:28 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:28.732785 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b709b53b-21d0-4cfd-bb2a-dfea79220d65 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:28.733402 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b709b53b-21d0-4cfd-bb2a-dfea79220d65 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:28.739930 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b709b53b-21d0-4cfd-bb2a-dfea79220d65 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:28.740372 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b709b53b-21d0-4cfd-bb2a-dfea79220d65 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:28.741695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b709b53b-21d0-4cfd-bb2a-dfea79220d65 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:28.742711 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b709b53b-21d0-4cfd-bb2a-dfea79220d65 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:28.875128 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b709b53b-21d0-4cfd-bb2a-dfea79220d65 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:28.882816 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b709b53b-21d0-4cfd-bb2a-dfea79220d65 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1315 microversion: 2.1 time: 0.153921 May 17 22:10:28.883407 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 98/202] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:28 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:29.380845 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-07d2e44c-49d0-48e0-8154-73789206462e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:29.381468 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-07d2e44c-49d0-48e0-8154-73789206462e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:29.392180 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07d2e44c-49d0-48e0-8154-73789206462e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:29.392180 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07d2e44c-49d0-48e0-8154-73789206462e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:29.392180 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07d2e44c-49d0-48e0-8154-73789206462e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:29.392180 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07d2e44c-49d0-48e0-8154-73789206462e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:29.537223 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-07d2e44c-49d0-48e0-8154-73789206462e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:29.544773 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-07d2e44c-49d0-48e0-8154-73789206462e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.168048 May 17 22:10:29.545338 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 105/203] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:29 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:29.901330 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-67af40d9-d11c-4de1-b063-e987c91c017a tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:29.902079 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-67af40d9-d11c-4de1-b063-e987c91c017a tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:29.909139 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-67af40d9-d11c-4de1-b063-e987c91c017a tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:29.909814 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-67af40d9-d11c-4de1-b063-e987c91c017a tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:29.910588 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-67af40d9-d11c-4de1-b063-e987c91c017a tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:29.911017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-67af40d9-d11c-4de1-b063-e987c91c017a tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:30.060071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-67af40d9-d11c-4de1-b063-e987c91c017a tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:30.067475 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-67af40d9-d11c-4de1-b063-e987c91c017a tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1464 microversion: 2.1 time: 0.171672 May 17 22:10:30.068029 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 99/204] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:29 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1464 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:30.108489 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a01a5d29-9761-4fa7-88d6-cd17acd81d26 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:30.108982 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a01a5d29-9761-4fa7-88d6-cd17acd81d26 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:30.114926 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a01a5d29-9761-4fa7-88d6-cd17acd81d26 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:30.115383 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a01a5d29-9761-4fa7-88d6-cd17acd81d26 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:30.116648 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a01a5d29-9761-4fa7-88d6-cd17acd81d26 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:30.117082 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a01a5d29-9761-4fa7-88d6-cd17acd81d26 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:30.141880 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a01a5d29-9761-4fa7-88d6-cd17acd81d26 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:10:30.471036 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a01a5d29-9761-4fa7-88d6-cd17acd81d26 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "DELETE /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 204 len: 0 microversion: 2.1 time: 0.366164 May 17 22:10:30.471666 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 106/205] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:10:30 2022] DELETE /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:10:30.483428 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-68be4ef4-400b-48dc-bffd-dc65ad613418 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:30.484027 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-68be4ef4-400b-48dc-bffd-dc65ad613418 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:30.489877 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68be4ef4-400b-48dc-bffd-dc65ad613418 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:30.490320 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68be4ef4-400b-48dc-bffd-dc65ad613418 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:30.491968 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68be4ef4-400b-48dc-bffd-dc65ad613418 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:30.492428 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68be4ef4-400b-48dc-bffd-dc65ad613418 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:30.567746 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d180eb04-b4fa-4345-8aaa-29ce4555ed37 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:30.568618 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d180eb04-b4fa-4345-8aaa-29ce4555ed37 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:30.574851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d180eb04-b4fa-4345-8aaa-29ce4555ed37 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:30.576293 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d180eb04-b4fa-4345-8aaa-29ce4555ed37 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:30.576293 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d180eb04-b4fa-4345-8aaa-29ce4555ed37 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:30.576610 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d180eb04-b4fa-4345-8aaa-29ce4555ed37 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:30.654021 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-68be4ef4-400b-48dc-bffd-dc65ad613418 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:30.661386 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-68be4ef4-400b-48dc-bffd-dc65ad613418 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1470 microversion: 2.1 time: 0.181737 May 17 22:10:30.662316 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 100/206] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:30 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:10:30.716063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d180eb04-b4fa-4345-8aaa-29ce4555ed37 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:30.723281 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d180eb04-b4fa-4345-8aaa-29ce4555ed37 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.159706 May 17 22:10:30.723850 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 107/207] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:30 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:10:31.680914 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bb015574-9dd6-44db-8586-5edf0725deff tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:31.681456 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bb015574-9dd6-44db-8586-5edf0725deff tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:31.688197 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bb015574-9dd6-44db-8586-5edf0725deff tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:31.688642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bb015574-9dd6-44db-8586-5edf0725deff tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:31.689404 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bb015574-9dd6-44db-8586-5edf0725deff tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:31.689831 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bb015574-9dd6-44db-8586-5edf0725deff tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:31.739717 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-444b263d-3f94-4a21-8025-6521c61de661 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:31.740405 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-444b263d-3f94-4a21-8025-6521c61de661 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:31.746425 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-444b263d-3f94-4a21-8025-6521c61de661 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:31.747421 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-444b263d-3f94-4a21-8025-6521c61de661 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:31.747704 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-444b263d-3f94-4a21-8025-6521c61de661 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:31.748128 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-444b263d-3f94-4a21-8025-6521c61de661 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:31.872614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bb015574-9dd6-44db-8586-5edf0725deff tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:31.880012 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bb015574-9dd6-44db-8586-5edf0725deff tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1470 microversion: 2.1 time: 0.204172 May 17 22:10:31.880590 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 101/208] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:31 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1470 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:31.906707 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-444b263d-3f94-4a21-8025-6521c61de661 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:31.914699 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-444b263d-3f94-4a21-8025-6521c61de661 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.178838 May 17 22:10:31.915285 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 108/209] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:31 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:10:32.897458 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5249af31-79a8-4062-b57e-fedc4141b741 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:32.898499 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5249af31-79a8-4062-b57e-fedc4141b741 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:32.904923 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5249af31-79a8-4062-b57e-fedc4141b741 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:32.905378 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5249af31-79a8-4062-b57e-fedc4141b741 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:32.906189 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5249af31-79a8-4062-b57e-fedc4141b741 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:32.906627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5249af31-79a8-4062-b57e-fedc4141b741 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:32.932648 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-82c2ce2d-33b2-4c2a-b082-30f1da5ecf80 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:32.933254 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-82c2ce2d-33b2-4c2a-b082-30f1da5ecf80 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:32.939734 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-82c2ce2d-33b2-4c2a-b082-30f1da5ecf80 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:32.940175 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-82c2ce2d-33b2-4c2a-b082-30f1da5ecf80 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:32.940935 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-82c2ce2d-33b2-4c2a-b082-30f1da5ecf80 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:32.941362 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-82c2ce2d-33b2-4c2a-b082-30f1da5ecf80 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:33.086169 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5249af31-79a8-4062-b57e-fedc4141b741 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:33.093419 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5249af31-79a8-4062-b57e-fedc4141b741 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1470 microversion: 2.1 time: 0.200048 May 17 22:10:33.094099 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 102/210] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:32 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:33.111790 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-82c2ce2d-33b2-4c2a-b082-30f1da5ecf80 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:33.120110 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-82c2ce2d-33b2-4c2a-b082-30f1da5ecf80 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.192240 May 17 22:10:33.120676 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 109/211] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:32 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:10:34.109629 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d98331bd-73b4-4a7e-8ae8-990c233954d8 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:34.110262 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d98331bd-73b4-4a7e-8ae8-990c233954d8 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:34.116717 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d98331bd-73b4-4a7e-8ae8-990c233954d8 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:34.117239 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d98331bd-73b4-4a7e-8ae8-990c233954d8 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:34.118157 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d98331bd-73b4-4a7e-8ae8-990c233954d8 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:34.118684 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d98331bd-73b4-4a7e-8ae8-990c233954d8 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:34.137190 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ba848857-db19-43a4-b3a7-fd35bd444691 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:34.137800 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ba848857-db19-43a4-b3a7-fd35bd444691 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:34.143984 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ba848857-db19-43a4-b3a7-fd35bd444691 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:34.144436 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ba848857-db19-43a4-b3a7-fd35bd444691 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:34.145264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ba848857-db19-43a4-b3a7-fd35bd444691 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:34.145636 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ba848857-db19-43a4-b3a7-fd35bd444691 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:34.313041 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d98331bd-73b4-4a7e-8ae8-990c233954d8 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:34.316806 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ba848857-db19-43a4-b3a7-fd35bd444691 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:34.320783 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d98331bd-73b4-4a7e-8ae8-990c233954d8 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1470 microversion: 2.1 time: 0.214985 May 17 22:10:34.321348 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 103/212] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:34 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:34.324139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ba848857-db19-43a4-b3a7-fd35bd444691 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.190700 May 17 22:10:34.324700 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 110/213] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:34 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:10:35.338674 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9e3bc222-33fc-403b-b8b4-e65a5a9c80a5 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:35.339338 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9e3bc222-33fc-403b-b8b4-e65a5a9c80a5 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:35.341555 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ff43eb34-8033-4a2c-ac01-e13238d855a9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:35.342697 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ff43eb34-8033-4a2c-ac01-e13238d855a9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:35.346107 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9e3bc222-33fc-403b-b8b4-e65a5a9c80a5 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:35.346562 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9e3bc222-33fc-403b-b8b4-e65a5a9c80a5 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:35.347379 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9e3bc222-33fc-403b-b8b4-e65a5a9c80a5 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:35.348139 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9e3bc222-33fc-403b-b8b4-e65a5a9c80a5 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:35.349383 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ff43eb34-8033-4a2c-ac01-e13238d855a9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:35.352185 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ff43eb34-8033-4a2c-ac01-e13238d855a9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:35.353124 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ff43eb34-8033-4a2c-ac01-e13238d855a9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:35.353606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ff43eb34-8033-4a2c-ac01-e13238d855a9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:35.603095 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9e3bc222-33fc-403b-b8b4-e65a5a9c80a5 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:35.606278 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ff43eb34-8033-4a2c-ac01-e13238d855a9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:35.612584 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9e3bc222-33fc-403b-b8b4-e65a5a9c80a5 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1470 microversion: 2.1 time: 0.278214 May 17 22:10:35.613559 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 104/214] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:35 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:35.614269 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ff43eb34-8033-4a2c-ac01-e13238d855a9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.276730 May 17 22:10:35.614811 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 111/215] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:35 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:10:35.742137 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-c2f22512-3388-4173-aae7-a6e3405b579e req-85aaf412-e6f2-4aa0-b3d6-4d086d17842f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df663c37-787c-4720-be26-9e1456eb7c9a", "name": "network-vif-deleted", "tag": "f93bcb80-75a6-42b1-8212-a886f6acc352"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:10:35.750544 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c2f22512-3388-4173-aae7-a6e3405b579e req-85aaf412-e6f2-4aa0-b3d6-4d086d17842f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:35.751069 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c2f22512-3388-4173-aae7-a6e3405b579e req-85aaf412-e6f2-4aa0-b3d6-4d086d17842f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:35.763599 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-c2f22512-3388-4173-aae7-a6e3405b579e req-85aaf412-e6f2-4aa0-b3d6-4d086d17842f service nova] Creating event network-vif-deleted:f93bcb80-75a6-42b1-8212-a886f6acc352 for instance df663c37-787c-4720-be26-9e1456eb7c9a on hv-cinder-83998 May 17 22:10:35.768788 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-c2f22512-3388-4173-aae7-a6e3405b579e req-85aaf412-e6f2-4aa0-b3d6-4d086d17842f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030363 May 17 22:10:35.769378 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 105/216] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:10:36.630082 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8978ddd3-8dde-41df-a3bc-a3bbca32594c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:36.630852 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8978ddd3-8dde-41df-a3bc-a3bbca32594c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:36.632373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-80b44ff3-4cf4-4e7b-9504-28bf46f3cc30 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:36.633160 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-80b44ff3-4cf4-4e7b-9504-28bf46f3cc30 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:36.638101 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8978ddd3-8dde-41df-a3bc-a3bbca32594c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:36.638619 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8978ddd3-8dde-41df-a3bc-a3bbca32594c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:36.639495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8978ddd3-8dde-41df-a3bc-a3bbca32594c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:36.639970 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8978ddd3-8dde-41df-a3bc-a3bbca32594c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:36.641072 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80b44ff3-4cf4-4e7b-9504-28bf46f3cc30 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:36.641516 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80b44ff3-4cf4-4e7b-9504-28bf46f3cc30 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:36.642364 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80b44ff3-4cf4-4e7b-9504-28bf46f3cc30 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:36.642795 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80b44ff3-4cf4-4e7b-9504-28bf46f3cc30 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:36.676735 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8978ddd3-8dde-41df-a3bc-a3bbca32594c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:36.680378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8978ddd3-8dde-41df-a3bc-a3bbca32594c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:36.680378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-8978ddd3-8dde-41df-a3bc-a3bbca32594c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lazy-loading 'fault' on Instance uuid df663c37-787c-4720-be26-9e1456eb7c9a {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:10:36.776208 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8978ddd3-8dde-41df-a3bc-a3bbca32594c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc61ff90d7041968220543a037ddf3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53795e38f3b84b859ad65f6203156d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:36.784322 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8978ddd3-8dde-41df-a3bc-a3bbca32594c tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 200 len: 1305 microversion: 2.1 time: 0.157986 May 17 22:10:36.785407 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 112/217] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:36 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 1305 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:36.841410 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-80b44ff3-4cf4-4e7b-9504-28bf46f3cc30 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:36.848907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-80b44ff3-4cf4-4e7b-9504-28bf46f3cc30 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1522 microversion: 2.1 time: 0.221617 May 17 22:10:36.849515 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 106/218] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:36 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:10:37.802177 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5d1a5459-c450-47d4-a47c-653834399af1 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:37.802780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5d1a5459-c450-47d4-a47c-653834399af1 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] [instance: df663c37-787c-4720-be26-9e1456eb7c9a] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:37.809916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d1a5459-c450-47d4-a47c-653834399af1 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:37.810362 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d1a5459-c450-47d4-a47c-653834399af1 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:37.811266 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d1a5459-c450-47d4-a47c-653834399af1 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:37.811691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d1a5459-c450-47d4-a47c-653834399af1 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:37.828728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-5d1a5459-c450-47d4-a47c-653834399af1 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] HTTP exception thrown: Instance df663c37-787c-4720-be26-9e1456eb7c9a could not be found. May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5d1a5459-c450-47d4-a47c-653834399af1 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Request method failure captured: May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a HTTP/1.1 May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB1Bl2WT8R3edLrbLArGGwgIH9bkVYU_uIoQyceuLP2o3Mu0XZvDtNKgwvRia6IslOekNXy5X7Bx4eBRu2vOjB9a4rC7bwek80-8VoweHTz38qBH_S6zWGkoFYKWtJ3K2Ol6i2ajX6I9wd7SVJvDeFue6XNkMD1ZvwQMp1dkKTkD4bM May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 53795e38f3b84b859ad65f6203156d20 May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-VolumesNegativeTest-693064918 May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:10:37.830442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:10:37.831678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/53795e38f3b84b859ad65f6203156d20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_53795e38f3b84b859ad65f6203156d20", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/53795e38f3b84b859ad65f6203156d20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/53795e38f3b84b859ad65f6203156d20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:10:37.831678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-VolumesNegativeTest-693064918 May 17 22:10:37.831678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 53795e38f3b84b859ad65f6203156d20 May 17 22:10:37.831678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-VolumesNegativeTest-693064918 May 17 22:10:37.831678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-VolumesNegativeTest-693064918-project May 17 22:10:37.831678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:10:37.831678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:10:37.831678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 0fc61ff90d7041968220543a037ddf3a May 17 22:10:37.831678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-VolumesNegativeTest-693064918-project May 17 22:10:37.831678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:10:37.831678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance df663c37-787c-4720-be26-9e1456eb7c9a could not be found. May 17 22:10:37.831678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': 'df663c37-787c-4720-be26-9e1456eb7c9a'} May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df663c37-787c-4720-be26-9e1456eb7c9a could not be found. May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:10:37.832628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df663c37-787c-4720-be26-9e1456eb7c9a could not be found. May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df663c37-787c-4720-be26-9e1456eb7c9a could not be found. May 17 22:10:37.833799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:10:37.836727 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5d1a5459-c450-47d4-a47c-653834399af1 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] Returning 404 to user: Instance df663c37-787c-4720-be26-9e1456eb7c9a could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:10:37.836727 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5d1a5459-c450-47d4-a47c-653834399af1 tempest-VolumesNegativeTest-693064918 tempest-VolumesNegativeTest-693064918-project] 10.222.0.24 "GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a" status: 404 len: 111 microversion: 2.1 time: 0.034291 May 17 22:10:37.836727 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 113/219] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:37 2022] GET /compute/v2.1/servers/df663c37-787c-4720-be26-9e1456eb7c9a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:10:37.865628 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b3ff87ef-91f7-4f8d-99bf-1ab7582dd409 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:37.866883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b3ff87ef-91f7-4f8d-99bf-1ab7582dd409 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:37.873169 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b3ff87ef-91f7-4f8d-99bf-1ab7582dd409 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:37.879252 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b3ff87ef-91f7-4f8d-99bf-1ab7582dd409 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:37.879252 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b3ff87ef-91f7-4f8d-99bf-1ab7582dd409 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:37.879252 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b3ff87ef-91f7-4f8d-99bf-1ab7582dd409 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:38.029961 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b3ff87ef-91f7-4f8d-99bf-1ab7582dd409 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:38.038125 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b3ff87ef-91f7-4f8d-99bf-1ab7582dd409 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1502 microversion: 2.1 time: 0.175730 May 17 22:10:38.039138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 107/220] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:37 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:38.057492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7029f04c-f730-4ffc-8f93-b0a753801f44 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:38.058077 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7029f04c-f730-4ffc-8f93-b0a753801f44 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:38.064112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7029f04c-f730-4ffc-8f93-b0a753801f44 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:38.064553 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7029f04c-f730-4ffc-8f93-b0a753801f44 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:38.065302 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7029f04c-f730-4ffc-8f93-b0a753801f44 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:38.065723 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7029f04c-f730-4ffc-8f93-b0a753801f44 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:38.203138 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7029f04c-f730-4ffc-8f93-b0a753801f44 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:38.213713 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7029f04c-f730-4ffc-8f93-b0a753801f44 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1517 microversion: 2.1 time: 0.160741 May 17 22:10:38.214657 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 114/221] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:38 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:39.994272 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef3d746a-b0b5-4de4-8a30-ac64dda214e5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:10:39.995347 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ef3d746a-b0b5-4de4-8a30-ac64dda214e5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:40.002215 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef3d746a-b0b5-4de4-8a30-ac64dda214e5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:40.002726 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef3d746a-b0b5-4de4-8a30-ac64dda214e5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:40.003603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef3d746a-b0b5-4de4-8a30-ac64dda214e5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:40.004092 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef3d746a-b0b5-4de4-8a30-ac64dda214e5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:40.027206 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-ef3d746a-b0b5-4de4-8a30-ac64dda214e5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lazy-loading 'flavor' on Instance uuid 485c3cc1-ede2-4e51-ac41-c00abe07926e {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:10:40.268192 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ef3d746a-b0b5-4de4-8a30-ac64dda214e5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "POST /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e/action" status: 200 len: 32 microversion: 2.1 time: 0.278846 May 17 22:10:40.273521 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 108/222] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:10:39 2022] POST /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e/action => generated 32 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 22:10:40.278502 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-319210df-c389-42ba-bc6c-af10f89b55c4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:40.285119 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-319210df-c389-42ba-bc6c-af10f89b55c4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:40.296155 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-319210df-c389-42ba-bc6c-af10f89b55c4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:40.299571 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-319210df-c389-42ba-bc6c-af10f89b55c4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:40.299571 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-319210df-c389-42ba-bc6c-af10f89b55c4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:40.299571 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-319210df-c389-42ba-bc6c-af10f89b55c4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:40.431599 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-319210df-c389-42ba-bc6c-af10f89b55c4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:40.440220 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-319210df-c389-42ba-bc6c-af10f89b55c4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.165344 May 17 22:10:40.441279 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 115/223] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:40 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:41.458567 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6ad80956-eb9a-4d50-9832-019252e33a52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:41.459294 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6ad80956-eb9a-4d50-9832-019252e33a52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:41.465912 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6ad80956-eb9a-4d50-9832-019252e33a52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:41.466364 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6ad80956-eb9a-4d50-9832-019252e33a52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:41.467159 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6ad80956-eb9a-4d50-9832-019252e33a52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:41.467601 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6ad80956-eb9a-4d50-9832-019252e33a52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:41.600391 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6ad80956-eb9a-4d50-9832-019252e33a52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:41.607949 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6ad80956-eb9a-4d50-9832-019252e33a52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.154039 May 17 22:10:41.608526 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 109/224] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:41 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:42.632831 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2bc121a2-e82b-40e1-a3c2-080d72df6831 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:42.633628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2bc121a2-e82b-40e1-a3c2-080d72df6831 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:42.642630 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bc121a2-e82b-40e1-a3c2-080d72df6831 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:42.643082 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bc121a2-e82b-40e1-a3c2-080d72df6831 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:42.643890 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bc121a2-e82b-40e1-a3c2-080d72df6831 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:42.644328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bc121a2-e82b-40e1-a3c2-080d72df6831 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:42.882441 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2bc121a2-e82b-40e1-a3c2-080d72df6831 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:42.889959 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2bc121a2-e82b-40e1-a3c2-080d72df6831 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.261025 May 17 22:10:42.890721 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 116/225] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:42 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:43.907325 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e0b58070-760c-4ec6-9143-d1b43fabade6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:43.907942 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e0b58070-760c-4ec6-9143-d1b43fabade6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:43.913775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e0b58070-760c-4ec6-9143-d1b43fabade6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:43.914424 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e0b58070-760c-4ec6-9143-d1b43fabade6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:43.915747 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e0b58070-760c-4ec6-9143-d1b43fabade6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:43.916425 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e0b58070-760c-4ec6-9143-d1b43fabade6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:44.060646 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e0b58070-760c-4ec6-9143-d1b43fabade6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:44.068251 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e0b58070-760c-4ec6-9143-d1b43fabade6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.164864 May 17 22:10:44.068744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 110/226] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:43 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:45.085670 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-47ecb379-cdc3-45e6-a8b8-1218076e5bae tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:45.086263 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-47ecb379-cdc3-45e6-a8b8-1218076e5bae tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:45.092629 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-47ecb379-cdc3-45e6-a8b8-1218076e5bae tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:45.093266 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-47ecb379-cdc3-45e6-a8b8-1218076e5bae tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:45.094091 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-47ecb379-cdc3-45e6-a8b8-1218076e5bae tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:45.094520 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-47ecb379-cdc3-45e6-a8b8-1218076e5bae tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:45.229852 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-47ecb379-cdc3-45e6-a8b8-1218076e5bae tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:45.237091 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-47ecb379-cdc3-45e6-a8b8-1218076e5bae tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.155276 May 17 22:10:45.237768 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 117/227] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:45 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:46.253931 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-95d0b7f4-8e45-49df-b7c8-355d57ee17b4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:46.254483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-95d0b7f4-8e45-49df-b7c8-355d57ee17b4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:46.261547 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-95d0b7f4-8e45-49df-b7c8-355d57ee17b4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:46.262000 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-95d0b7f4-8e45-49df-b7c8-355d57ee17b4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:46.262772 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-95d0b7f4-8e45-49df-b7c8-355d57ee17b4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:46.263232 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-95d0b7f4-8e45-49df-b7c8-355d57ee17b4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:46.409869 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-95d0b7f4-8e45-49df-b7c8-355d57ee17b4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:46.417616 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-95d0b7f4-8e45-49df-b7c8-355d57ee17b4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.167593 May 17 22:10:46.418196 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 111/228] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:46 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:47.436465 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c14422bc-9b48-4b7f-98af-c2a586b66095 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:47.436996 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c14422bc-9b48-4b7f-98af-c2a586b66095 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:47.443030 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c14422bc-9b48-4b7f-98af-c2a586b66095 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:47.443518 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c14422bc-9b48-4b7f-98af-c2a586b66095 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:47.444331 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c14422bc-9b48-4b7f-98af-c2a586b66095 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:47.444767 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c14422bc-9b48-4b7f-98af-c2a586b66095 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:47.588880 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c14422bc-9b48-4b7f-98af-c2a586b66095 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:47.597313 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c14422bc-9b48-4b7f-98af-c2a586b66095 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.165230 May 17 22:10:47.600041 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 118/229] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:47 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:48.622517 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b6bf8a21-ff3e-48e5-960d-21bfb4f7e576 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:48.624191 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b6bf8a21-ff3e-48e5-960d-21bfb4f7e576 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:48.631877 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6bf8a21-ff3e-48e5-960d-21bfb4f7e576 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:48.632331 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6bf8a21-ff3e-48e5-960d-21bfb4f7e576 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:48.633117 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6bf8a21-ff3e-48e5-960d-21bfb4f7e576 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:48.633555 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6bf8a21-ff3e-48e5-960d-21bfb4f7e576 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:48.774566 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b6bf8a21-ff3e-48e5-960d-21bfb4f7e576 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:48.782498 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b6bf8a21-ff3e-48e5-960d-21bfb4f7e576 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.167162 May 17 22:10:48.782997 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 112/230] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:48 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:49.803259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4ca461b7-8cf5-4cd0-921f-9736cd3782cb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:49.804712 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4ca461b7-8cf5-4cd0-921f-9736cd3782cb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:49.815719 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4ca461b7-8cf5-4cd0-921f-9736cd3782cb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:49.818325 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4ca461b7-8cf5-4cd0-921f-9736cd3782cb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:49.820852 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4ca461b7-8cf5-4cd0-921f-9736cd3782cb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:49.821541 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4ca461b7-8cf5-4cd0-921f-9736cd3782cb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:50.126641 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4ca461b7-8cf5-4cd0-921f-9736cd3782cb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:50.146160 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4ca461b7-8cf5-4cd0-921f-9736cd3782cb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.348045 May 17 22:10:50.161583 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 119/231] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:49 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:51.178297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f32e780a-81dd-46fc-a27f-dcecc1fd3c09 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:51.178903 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f32e780a-81dd-46fc-a27f-dcecc1fd3c09 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:51.194820 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f32e780a-81dd-46fc-a27f-dcecc1fd3c09 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:51.195474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f32e780a-81dd-46fc-a27f-dcecc1fd3c09 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:51.196499 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f32e780a-81dd-46fc-a27f-dcecc1fd3c09 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:51.197049 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f32e780a-81dd-46fc-a27f-dcecc1fd3c09 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:51.403680 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f32e780a-81dd-46fc-a27f-dcecc1fd3c09 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:51.417227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f32e780a-81dd-46fc-a27f-dcecc1fd3c09 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.251782 May 17 22:10:51.417926 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 113/232] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:51 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:52.435016 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ae91d0c3-38db-4af2-8ab1-1d88fa6fa6c6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:52.436399 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ae91d0c3-38db-4af2-8ab1-1d88fa6fa6c6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:52.451889 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae91d0c3-38db-4af2-8ab1-1d88fa6fa6c6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:52.455095 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae91d0c3-38db-4af2-8ab1-1d88fa6fa6c6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:52.456980 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae91d0c3-38db-4af2-8ab1-1d88fa6fa6c6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:52.457445 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae91d0c3-38db-4af2-8ab1-1d88fa6fa6c6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:52.707239 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ae91d0c3-38db-4af2-8ab1-1d88fa6fa6c6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:52.714714 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ae91d0c3-38db-4af2-8ab1-1d88fa6fa6c6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.284852 May 17 22:10:52.715351 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 120/233] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:52 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:53.732346 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0c2a8e18-f409-4ebe-a6b8-c751b67311d5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:53.732941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0c2a8e18-f409-4ebe-a6b8-c751b67311d5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:53.739346 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c2a8e18-f409-4ebe-a6b8-c751b67311d5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:53.740195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c2a8e18-f409-4ebe-a6b8-c751b67311d5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:53.741197 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c2a8e18-f409-4ebe-a6b8-c751b67311d5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:53.741636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c2a8e18-f409-4ebe-a6b8-c751b67311d5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:53.952231 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0c2a8e18-f409-4ebe-a6b8-c751b67311d5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:53.969629 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0c2a8e18-f409-4ebe-a6b8-c751b67311d5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.242190 May 17 22:10:53.970361 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 114/234] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:53 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:54.999614 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-887b4fe5-e51d-45b0-9d20-c1051aac6637 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:55.000239 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-887b4fe5-e51d-45b0-9d20-c1051aac6637 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:55.018017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-887b4fe5-e51d-45b0-9d20-c1051aac6637 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:55.021389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-887b4fe5-e51d-45b0-9d20-c1051aac6637 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:55.021389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-887b4fe5-e51d-45b0-9d20-c1051aac6637 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:55.021389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-887b4fe5-e51d-45b0-9d20-c1051aac6637 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:55.255619 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-887b4fe5-e51d-45b0-9d20-c1051aac6637 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:55.267196 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-887b4fe5-e51d-45b0-9d20-c1051aac6637 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.280222 May 17 22:10:55.267196 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 121/235] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:54 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:56.065811 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4892acab-c9dc-41e3-b496-f3f66424e45c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:56.066349 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4892acab-c9dc-41e3-b496-f3f66424e45c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:56.073180 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4892acab-c9dc-41e3-b496-f3f66424e45c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:56.073673 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4892acab-c9dc-41e3-b496-f3f66424e45c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:56.074689 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4892acab-c9dc-41e3-b496-f3f66424e45c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:56.075153 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4892acab-c9dc-41e3-b496-f3f66424e45c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:56.106211 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4892acab-c9dc-41e3-b496-f3f66424e45c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831/ips" status: 200 len: 150 microversion: 2.1 time: 0.044489 May 17 22:10:56.106810 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 115/236] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 17 22:10:56 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:10:56.284649 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-28144f90-345e-4132-b36a-5685d5b11983 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:56.285970 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-28144f90-345e-4132-b36a-5685d5b11983 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:56.294957 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-28144f90-345e-4132-b36a-5685d5b11983 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:56.295734 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-28144f90-345e-4132-b36a-5685d5b11983 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:56.296596 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-28144f90-345e-4132-b36a-5685d5b11983 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:56.297264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-28144f90-345e-4132-b36a-5685d5b11983 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:56.491031 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-28144f90-345e-4132-b36a-5685d5b11983 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:56.499737 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-28144f90-345e-4132-b36a-5685d5b11983 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.220231 May 17 22:10:56.510073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 122/237] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:56 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:57.113118 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-421eb1cb-e7f9-4f62-adea-faed0e6eadfe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:57.113563 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-421eb1cb-e7f9-4f62-adea-faed0e6eadfe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:57.125828 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-421eb1cb-e7f9-4f62-adea-faed0e6eadfe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:57.128172 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-421eb1cb-e7f9-4f62-adea-faed0e6eadfe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:57.128172 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-421eb1cb-e7f9-4f62-adea-faed0e6eadfe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:57.128172 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-421eb1cb-e7f9-4f62-adea-faed0e6eadfe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:57.166670 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-771884326", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "networks": [{"uuid": "728fcf69-a03b-4660-ab19-7ef744bf8d9d"}]}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:10:57.188139 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-421eb1cb-e7f9-4f62-adea-faed0e6eadfe tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/ips" status: 200 len: 151 microversion: 2.20 time: 0.080299 May 17 22:10:57.189267 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 116/238] 10.222.0.24 () {60 vars in 1288 bytes} [Tue May 17 22:10:57 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/ips => generated 151 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:10:57.233945 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] validate_networks() for [('728fcf69-a03b-4660-ab19-7ef744bf8d9d', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:10:57.492579 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fc423770-fdc1-415a-86f6-b946e2772047 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:57.493159 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fc423770-fdc1-415a-86f6-b946e2772047 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:57.500846 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc423770-fdc1-415a-86f6-b946e2772047 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:57.501310 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc423770-fdc1-415a-86f6-b946e2772047 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:57.502089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc423770-fdc1-415a-86f6-b946e2772047 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:57.504368 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc423770-fdc1-415a-86f6-b946e2772047 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:57.541246 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fc423770-fdc1-415a-86f6-b946e2772047 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/ips" status: 200 len: 146 microversion: 2.1 time: 0.052524 May 17 22:10:57.543252 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 117/239] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 17 22:10:57 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/ips => generated 146 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:10:57.548530 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3e627c60-e4ab-45be-8fa6-5c41f3afe27f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:57.549332 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3e627c60-e4ab-45be-8fa6-5c41f3afe27f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:57.561562 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e627c60-e4ab-45be-8fa6-5c41f3afe27f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:57.562283 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e627c60-e4ab-45be-8fa6-5c41f3afe27f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:57.563300 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e627c60-e4ab-45be-8fa6-5c41f3afe27f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:57.563900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e627c60-e4ab-45be-8fa6-5c41f3afe27f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:57.950888 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3e627c60-e4ab-45be-8fa6-5c41f3afe27f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:57.958684 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3e627c60-e4ab-45be-8fa6-5c41f3afe27f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1503 microversion: 2.1 time: 0.414173 May 17 22:10:57.960405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 118/240] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:57 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1503 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:57.981565 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bd0477d4-fd7e-4955-8f1b-6d47ad8652b7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "582d2902-a1ca-49a7-8035-f9b794120a35"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:10:57.982799 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bd0477d4-fd7e-4955-8f1b-6d47ad8652b7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:57.990417 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd0477d4-fd7e-4955-8f1b-6d47ad8652b7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:57.994798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd0477d4-fd7e-4955-8f1b-6d47ad8652b7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:57.994798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd0477d4-fd7e-4955-8f1b-6d47ad8652b7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:57.994798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd0477d4-fd7e-4955-8f1b-6d47ad8652b7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:58.037801 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-bd0477d4-fd7e-4955-8f1b-6d47ad8652b7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] HTTP exception thrown: Cannot 'attach_volume' instance 485c3cc1-ede2-4e51-ac41-c00abe07926e while it is in vm_state rescued May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bd0477d4-fd7e-4955-8f1b-6d47ad8652b7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Request method failure captured: May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: POST /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e/os-volume_attachments HTTP/1.1 May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 74 May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0P0UB5_uQfKTuVZPhH7DNkYAdH4uRgkhSs_b6rbwPZ_1fapkgG_r3KdEbs4XGm2C_Rp1CTTOgvsoNQrwuCSt2PBbkFf06sbYA1Ukg8-odEmBZ2p0sSFzwtGdwavI4iQdBU7car_6jAD2weQQcjBgdczxsrbNA_K4dLU0356ZlF5Ao May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 7a0d6701b5d5441eb7eaf815d273d4d9 May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:10:58.041936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:10:58.043318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7a0d6701b5d5441eb7eaf815d273d4d9", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:10:58.043318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:10:58.043318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 7a0d6701b5d5441eb7eaf815d273d4d9 May 17 22:10:58.043318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:10:58.043318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-ServerRescueNegativeTestJSON-127931416-project May 17 22:10:58.043318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:10:58.043318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:10:58.043318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 8cc69cd4250c436e8b893887604b2273 May 17 22:10:58.043318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-127931416-project May 17 22:10:58.043318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: May 17 22:10:58.043318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {"volumeAttachment": {"volumeId": "582d2902-a1ca-49a7-8035-f9b794120a35"}} May 17 22:10:58.043318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Cannot 'attach_volume' instance 485c3cc1-ede2-4e51-ac41-c00abe07926e while it is in vm_state rescued May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'server_id': '485c3cc1-ede2-4e51-ac41-c00abe07926e', 'body': {'volumeAttachment': {'volumeId': '582d2902-a1ca-49a7-8035-f9b794120a35'}}} May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 485c3cc1-ede2-4e51-ac41-c00abe07926e in vm_state rescued. Cannot attach_volume while the instance is in this state. May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:10:58.044166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 485c3cc1-ede2-4e51-ac41-c00abe07926e while it is in vm_state rescued May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:10:58.045993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:10:58.047845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:10:58.047845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:10:58.047845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 485c3cc1-ede2-4e51-ac41-c00abe07926e while it is in vm_state rescued May 17 22:10:58.047845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:10:58.047845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bd0477d4-fd7e-4955-8f1b-6d47ad8652b7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Returning 409 to user: Cannot 'attach_volume' instance 485c3cc1-ede2-4e51-ac41-c00abe07926e while it is in vm_state rescued {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:10:58.047845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bd0477d4-fd7e-4955-8f1b-6d47ad8652b7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "POST /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.070534 May 17 22:10:58.047845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 119/241] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:10:57 2022] POST /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 17 22:10:58.054507 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-52d02441-16a2-470b-a112-812989f37b08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:10:58.055033 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-52d02441-16a2-470b-a112-812989f37b08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:58.064037 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52d02441-16a2-470b-a112-812989f37b08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:58.064487 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52d02441-16a2-470b-a112-812989f37b08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:58.065261 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52d02441-16a2-470b-a112-812989f37b08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:58.065738 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52d02441-16a2-470b-a112-812989f37b08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:58.342554 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-52d02441-16a2-470b-a112-812989f37b08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "POST /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e/action" status: 202 len: 0 microversion: 2.1 time: 0.288055 May 17 22:10:58.342554 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 120/242] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:10:58 2022] POST /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 22:10:58.353362 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-efff6b85-4393-4825-a38d-77c95180d84b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99dfd24f-271d-4bfb-a06b-1cc0830b14b1"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:10:58.361009 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-efff6b85-4393-4825-a38d-77c95180d84b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:58.387068 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-efff6b85-4393-4825-a38d-77c95180d84b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:58.388789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-efff6b85-4393-4825-a38d-77c95180d84b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:58.390776 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-efff6b85-4393-4825-a38d-77c95180d84b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:58.392187 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-efff6b85-4393-4825-a38d-77c95180d84b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:58.686980 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:10:58.688034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:10:58.688656 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:10:58.690255 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:10:58.690707 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:10:58.709302 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:58.709780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:58.710737 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:58.711022 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:58.732133 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Getting quotas for project 93c1c0a74d6a4392947ee727aa1d3da3. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:10:58.741497 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Getting quotas for user 98f1a5f6023e47c8b84edab34b308094 and project 93c1c0a74d6a4392947ee727aa1d3da3. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:10:58.765854 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:10:58.770023 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:10:58.941978 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e7af549e-77ff-4ae5-b84d-41a6895899f3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.780523 May 17 22:10:58.942874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 123/243] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:10:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 22:10:58.950744 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-89aaf4a7-4890-44d2-9433-42ce25f981c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:58.951409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-89aaf4a7-4890-44d2-9433-42ce25f981c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:58.958071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89aaf4a7-4890-44d2-9433-42ce25f981c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:58.958929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89aaf4a7-4890-44d2-9433-42ce25f981c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:58.960042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89aaf4a7-4890-44d2-9433-42ce25f981c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:10:58.960654 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-89aaf4a7-4890-44d2-9433-42ce25f981c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:10:59.531227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-89aaf4a7-4890-44d2-9433-42ce25f981c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:59.544142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-89aaf4a7-4890-44d2-9433-42ce25f981c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1511 microversion: 2.1 time: 0.599814 May 17 22:10:59.547708 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 124/244] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:58 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1511 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:10:59.553514 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8e7ed4db-b4ab-4a03-ad07-3fc373066906 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:10:59.557090 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8e7ed4db-b4ab-4a03-ad07-3fc373066906 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:10:59.655398 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-efff6b85-4393-4825-a38d-77c95180d84b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.314045 May 17 22:10:59.662618 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 121/245] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:10:58 2022] POST /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831/os-volume_attachments => generated 194 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:10:59.662948 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8e7ed4db-b4ab-4a03-ad07-3fc373066906 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:10:59.671054 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8e7ed4db-b4ab-4a03-ad07-3fc373066906 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1218 microversion: 2.1 time: 0.121887 May 17 22:10:59.674102 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 125/246] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:10:59 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:00.072234 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5a544579-ed95-4211-9d5d-07ac2bfeb598 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:00.072868 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5a544579-ed95-4211-9d5d-07ac2bfeb598 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:00.088476 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5a544579-ed95-4211-9d5d-07ac2bfeb598 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:00.088956 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5a544579-ed95-4211-9d5d-07ac2bfeb598 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:00.093218 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5a544579-ed95-4211-9d5d-07ac2bfeb598 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:00.093676 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5a544579-ed95-4211-9d5d-07ac2bfeb598 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:00.167092 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-5a544579-ed95-4211-9d5d-07ac2bfeb598 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lazy-loading 'flavor' on Instance uuid 5c568a7b-6b45-45c4-b60a-3514d7c43e6e {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:11:00.565193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d5d1665d-3baf-4ceb-a588-1efe1d9ac718 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:00.565788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d5d1665d-3baf-4ceb-a588-1efe1d9ac718 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:00.573131 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5d1665d-3baf-4ceb-a588-1efe1d9ac718 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:00.573575 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5d1665d-3baf-4ceb-a588-1efe1d9ac718 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:00.574336 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5d1665d-3baf-4ceb-a588-1efe1d9ac718 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:00.574765 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5d1665d-3baf-4ceb-a588-1efe1d9ac718 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:00.771195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5a544579-ed95-4211-9d5d-07ac2bfeb598 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "POST /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/action" status: 202 len: 0 microversion: 2.20 time: 0.703101 May 17 22:11:00.773432 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 122/247] 10.222.0.24 () {62 vars in 1318 bytes} [Tue May 17 22:11:00 2022] POST /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 22:11:00.780294 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-73541b0b-59b0-43ab-96d4-a209db0b32ca tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:00.781815 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-73541b0b-59b0-43ab-96d4-a209db0b32ca tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:00.789952 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-73541b0b-59b0-43ab-96d4-a209db0b32ca tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:00.791094 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-73541b0b-59b0-43ab-96d4-a209db0b32ca tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:00.792608 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-73541b0b-59b0-43ab-96d4-a209db0b32ca tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:00.793212 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-73541b0b-59b0-43ab-96d4-a209db0b32ca tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:00.803587 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d5d1665d-3baf-4ceb-a588-1efe1d9ac718 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:00.817166 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d5d1665d-3baf-4ceb-a588-1efe1d9ac718 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1511 microversion: 2.1 time: 0.255756 May 17 22:11:00.817960 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 126/248] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:00 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:00.825719 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e8236712-dc4d-429b-b1cb-f97c1f8e6281 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:00.830858 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e8236712-dc4d-429b-b1cb-f97c1f8e6281 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:00.837803 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e8236712-dc4d-429b-b1cb-f97c1f8e6281 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:00.838334 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e8236712-dc4d-429b-b1cb-f97c1f8e6281 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:00.839353 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e8236712-dc4d-429b-b1cb-f97c1f8e6281 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:00.839862 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e8236712-dc4d-429b-b1cb-f97c1f8e6281 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:00.901215 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-73541b0b-59b0-43ab-96d4-a209db0b32ca tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:00.909067 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-73541b0b-59b0-43ab-96d4-a209db0b32ca tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1222 microversion: 2.1 time: 0.133942 May 17 22:11:00.910074 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 123/249] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:00 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:01.005800 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e8236712-dc4d-429b-b1cb-f97c1f8e6281 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:01.014585 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e8236712-dc4d-429b-b1cb-f97c1f8e6281 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:01.024993 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e8236712-dc4d-429b-b1cb-f97c1f8e6281 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:01.024993 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e8236712-dc4d-429b-b1cb-f97c1f8e6281 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.199218 May 17 22:11:01.024993 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 127/250] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:00 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:01.838981 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f882808b-821d-4284-8dd1-e543b6cbae26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:01.845346 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f882808b-821d-4284-8dd1-e543b6cbae26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:01.860435 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f882808b-821d-4284-8dd1-e543b6cbae26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:01.860917 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f882808b-821d-4284-8dd1-e543b6cbae26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:01.861721 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f882808b-821d-4284-8dd1-e543b6cbae26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:01.862152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f882808b-821d-4284-8dd1-e543b6cbae26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:01.925948 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-914b3599-170e-4a68-a7de-75ad6c01e0f2 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:01.927100 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-914b3599-170e-4a68-a7de-75ad6c01e0f2 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:01.934587 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-914b3599-170e-4a68-a7de-75ad6c01e0f2 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:01.935031 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-914b3599-170e-4a68-a7de-75ad6c01e0f2 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:01.935836 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-914b3599-170e-4a68-a7de-75ad6c01e0f2 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:01.936269 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-914b3599-170e-4a68-a7de-75ad6c01e0f2 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:02.022290 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-914b3599-170e-4a68-a7de-75ad6c01e0f2 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:02.034544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-914b3599-170e-4a68-a7de-75ad6c01e0f2 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1222 microversion: 2.1 time: 0.112490 May 17 22:11:02.040354 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 128/251] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:01 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:02.052830 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e192cc80-98f1-4437-9bad-8320eb70fb09 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:02.053605 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e192cc80-98f1-4437-9bad-8320eb70fb09 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:02.054291 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f882808b-821d-4284-8dd1-e543b6cbae26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:02.066665 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f882808b-821d-4284-8dd1-e543b6cbae26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1511 microversion: 2.1 time: 0.233474 May 17 22:11:02.067864 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e192cc80-98f1-4437-9bad-8320eb70fb09 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:02.068232 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 124/252] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:01 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:02.068522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e192cc80-98f1-4437-9bad-8320eb70fb09 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:02.069411 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e192cc80-98f1-4437-9bad-8320eb70fb09 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:02.070062 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e192cc80-98f1-4437-9bad-8320eb70fb09 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:02.269710 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e192cc80-98f1-4437-9bad-8320eb70fb09 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:02.278068 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e192cc80-98f1-4437-9bad-8320eb70fb09 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:02.279616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e192cc80-98f1-4437-9bad-8320eb70fb09 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:02.280961 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e192cc80-98f1-4437-9bad-8320eb70fb09 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.235533 May 17 22:11:02.281525 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 129/253] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:02 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:03.061136 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c2ab72bf-be96-4134-98a2-2b8f74f3343c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:03.070546 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c2ab72bf-be96-4134-98a2-2b8f74f3343c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:03.085423 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6c4507a3-b496-42bf-90d9-def0d47e5d52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:03.087286 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6c4507a3-b496-42bf-90d9-def0d47e5d52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:03.098412 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c2ab72bf-be96-4134-98a2-2b8f74f3343c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:03.100222 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c2ab72bf-be96-4134-98a2-2b8f74f3343c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:03.101327 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c2ab72bf-be96-4134-98a2-2b8f74f3343c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:03.104003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c2ab72bf-be96-4134-98a2-2b8f74f3343c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:03.111009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6c4507a3-b496-42bf-90d9-def0d47e5d52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:03.111930 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6c4507a3-b496-42bf-90d9-def0d47e5d52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:03.112717 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6c4507a3-b496-42bf-90d9-def0d47e5d52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:03.113156 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6c4507a3-b496-42bf-90d9-def0d47e5d52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:03.305560 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c2ab72bf-be96-4134-98a2-2b8f74f3343c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:03.318951 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c2ab72bf-be96-4134-98a2-2b8f74f3343c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1222 microversion: 2.1 time: 0.266157 May 17 22:11:03.331271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 125/254] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:03 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1222 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:03.336162 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7c006efb-482f-45e3-ada3-92332ca449ee tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:03.337496 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7c006efb-482f-45e3-ada3-92332ca449ee tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:03.349310 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c006efb-482f-45e3-ada3-92332ca449ee tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:03.350045 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c006efb-482f-45e3-ada3-92332ca449ee tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:03.351397 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c006efb-482f-45e3-ada3-92332ca449ee tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:03.352858 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c006efb-482f-45e3-ada3-92332ca449ee tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:03.390986 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6c4507a3-b496-42bf-90d9-def0d47e5d52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:03.399087 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6c4507a3-b496-42bf-90d9-def0d47e5d52 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1511 microversion: 2.1 time: 0.318121 May 17 22:11:03.408591 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 130/255] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:03 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:03.413665 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-14d07fd4-5ce8-4e95-b092-42517a6acea0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a00d9f1-b3c1-40af-ae3e-c564426f56b7"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:03.417623 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-14d07fd4-5ce8-4e95-b092-42517a6acea0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:03.424089 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-14d07fd4-5ce8-4e95-b092-42517a6acea0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:03.425061 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-14d07fd4-5ce8-4e95-b092-42517a6acea0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:03.425753 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-14d07fd4-5ce8-4e95-b092-42517a6acea0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:03.426348 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-14d07fd4-5ce8-4e95-b092-42517a6acea0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:03.564080 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c006efb-482f-45e3-ada3-92332ca449ee tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:03.574955 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c006efb-482f-45e3-ada3-92332ca449ee tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:03.576717 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c006efb-482f-45e3-ada3-92332ca449ee tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:03.578145 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7c006efb-482f-45e3-ada3-92332ca449ee tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.245749 May 17 22:11:03.589879 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 126/256] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:03 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:04.339299 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9ea5670b-bbe7-49e7-93a1-60c703ecaaf5 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:04.340047 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9ea5670b-bbe7-49e7-93a1-60c703ecaaf5 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:04.346257 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9ea5670b-bbe7-49e7-93a1-60c703ecaaf5 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:04.346962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9ea5670b-bbe7-49e7-93a1-60c703ecaaf5 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:04.348296 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9ea5670b-bbe7-49e7-93a1-60c703ecaaf5 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:04.349315 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9ea5670b-bbe7-49e7-93a1-60c703ecaaf5 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:04.474891 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9ea5670b-bbe7-49e7-93a1-60c703ecaaf5 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:04.484313 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9ea5670b-bbe7-49e7-93a1-60c703ecaaf5 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1214 microversion: 2.1 time: 0.151091 May 17 22:11:04.485204 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 127/257] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:04 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:04.490235 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-654599bf-59ea-4216-9fce-fa183091f9ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:04.491796 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-654599bf-59ea-4216-9fce-fa183091f9ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:04.514216 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-654599bf-59ea-4216-9fce-fa183091f9ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:04.519489 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-654599bf-59ea-4216-9fce-fa183091f9ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:04.519489 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-654599bf-59ea-4216-9fce-fa183091f9ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:04.519489 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-654599bf-59ea-4216-9fce-fa183091f9ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:04.701720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-654599bf-59ea-4216-9fce-fa183091f9ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:04.706773 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-654599bf-59ea-4216-9fce-fa183091f9ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1517 microversion: 2.1 time: 0.220293 May 17 22:11:04.707367 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 128/258] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:04 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:04.714180 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8a8b794b-0e7a-434b-b8d3-584f9820c271 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:04.714960 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8a8b794b-0e7a-434b-b8d3-584f9820c271 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:04.730039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8a8b794b-0e7a-434b-b8d3-584f9820c271 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:04.735547 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8a8b794b-0e7a-434b-b8d3-584f9820c271 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:04.735547 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8a8b794b-0e7a-434b-b8d3-584f9820c271 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:04.735547 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8a8b794b-0e7a-434b-b8d3-584f9820c271 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:04.937666 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8a8b794b-0e7a-434b-b8d3-584f9820c271 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:04.949147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8a8b794b-0e7a-434b-b8d3-584f9820c271 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:04.960382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8a8b794b-0e7a-434b-b8d3-584f9820c271 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:04.960382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8a8b794b-0e7a-434b-b8d3-584f9820c271 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.248369 May 17 22:11:04.969823 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 129/259] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:04 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:05.350209 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-14d07fd4-5ce8-4e95-b092-42517a6acea0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "POST /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.940117 May 17 22:11:05.352436 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 131/260] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:11:03 2022] POST /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/os-volume_attachments => generated 194 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:11:05.502877 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c8eea200-53b0-4539-97ed-a5364f122417 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:05.503499 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c8eea200-53b0-4539-97ed-a5364f122417 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:05.519087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8eea200-53b0-4539-97ed-a5364f122417 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:05.519087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8eea200-53b0-4539-97ed-a5364f122417 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:05.519087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8eea200-53b0-4539-97ed-a5364f122417 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:05.519087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8eea200-53b0-4539-97ed-a5364f122417 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:05.613146 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c8eea200-53b0-4539-97ed-a5364f122417 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:05.622656 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c8eea200-53b0-4539-97ed-a5364f122417 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1288 microversion: 2.1 time: 0.122814 May 17 22:11:05.623454 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 130/261] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:05 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1288 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:05.978971 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-db738787-e2bd-4d92-9c13-12685dcd3508 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:05.979808 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-db738787-e2bd-4d92-9c13-12685dcd3508 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:06.002439 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-db738787-e2bd-4d92-9c13-12685dcd3508 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:06.005988 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-db738787-e2bd-4d92-9c13-12685dcd3508 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:06.007064 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-db738787-e2bd-4d92-9c13-12685dcd3508 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:06.011699 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-db738787-e2bd-4d92-9c13-12685dcd3508 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:06.346649 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-db738787-e2bd-4d92-9c13-12685dcd3508 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:06.362337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-db738787-e2bd-4d92-9c13-12685dcd3508 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:06.364031 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-db738787-e2bd-4d92-9c13-12685dcd3508 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:06.365533 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-db738787-e2bd-4d92-9c13-12685dcd3508 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.391808 May 17 22:11:06.366223 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 132/262] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:05 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:06.643489 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-77044271-f043-4fef-9765-67fde82d72a3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:06.644242 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-77044271-f043-4fef-9765-67fde82d72a3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:06.652694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77044271-f043-4fef-9765-67fde82d72a3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:06.659448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77044271-f043-4fef-9765-67fde82d72a3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:06.660776 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77044271-f043-4fef-9765-67fde82d72a3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:06.661447 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77044271-f043-4fef-9765-67fde82d72a3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:06.989428 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-77044271-f043-4fef-9765-67fde82d72a3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:06.997334 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-77044271-f043-4fef-9765-67fde82d72a3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.357875 May 17 22:11:07.007433 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 131/263] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:06 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:07.177691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ab61790b-bcdf-47a4-926b-a4e1dbe7153a tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Action: 'create', calling method: .version_select at 0x7f09f2485790>, body: {"keypair": {"name": "tempest-keypair-1562254185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXnnawfrlbTlRhUC8pTmUQwpMfE6WDskOpHQYq/ct20SigP2JEixXd2UeZjSE0BpP694go07Ew2SdF7mzOdvRKzkdg4UbZ3jSTAVgp4kfcSbmP0b6CNO2gNC1sdtKMroA=="}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:07.201427 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-ab61790b-bcdf-47a4-926b-a4e1dbe7153a tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Getting quotas for project 7a0d6701b5d5441eb7eaf815d273d4d9. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:11:07.207639 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-ab61790b-bcdf-47a4-926b-a4e1dbe7153a tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Getting quotas for user 8cc69cd4250c436e8b893887604b2273 and project 7a0d6701b5d5441eb7eaf815d273d4d9. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:11:07.348111 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ab61790b-bcdf-47a4-926b-a4e1dbe7153a tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174486 May 17 22:11:07.353297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 133/264] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 17 22:11:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:11:07.401582 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b28be7c2-44fc-4b55-b29f-e6b7cef447d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:07.401582 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b28be7c2-44fc-4b55-b29f-e6b7cef447d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:07.401582 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b28be7c2-44fc-4b55-b29f-e6b7cef447d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:07.401582 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b28be7c2-44fc-4b55-b29f-e6b7cef447d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:07.401955 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b28be7c2-44fc-4b55-b29f-e6b7cef447d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:07.401955 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b28be7c2-44fc-4b55-b29f-e6b7cef447d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:07.604826 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b28be7c2-44fc-4b55-b29f-e6b7cef447d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:07.612697 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b28be7c2-44fc-4b55-b29f-e6b7cef447d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:07.614203 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b28be7c2-44fc-4b55-b29f-e6b7cef447d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:07.615395 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b28be7c2-44fc-4b55-b29f-e6b7cef447d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.234148 May 17 22:11:07.615960 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 132/265] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:07 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:08.015424 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f92c1c9d-471d-48a2-9677-95afaf75f53b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:08.016077 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f92c1c9d-471d-48a2-9677-95afaf75f53b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:08.034637 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f92c1c9d-471d-48a2-9677-95afaf75f53b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:08.037210 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f92c1c9d-471d-48a2-9677-95afaf75f53b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:08.040846 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f92c1c9d-471d-48a2-9677-95afaf75f53b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:08.042408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f92c1c9d-471d-48a2-9677-95afaf75f53b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:08.363812 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f92c1c9d-471d-48a2-9677-95afaf75f53b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:08.380776 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f92c1c9d-471d-48a2-9677-95afaf75f53b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.369597 May 17 22:11:08.387318 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 134/266] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:08 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:08.635454 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-554c0281-0f4b-4711-a762-49baef4d319c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:08.636124 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-554c0281-0f4b-4711-a762-49baef4d319c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:08.645093 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-554c0281-0f4b-4711-a762-49baef4d319c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:08.650775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-554c0281-0f4b-4711-a762-49baef4d319c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:08.651889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-554c0281-0f4b-4711-a762-49baef4d319c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:08.652521 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-554c0281-0f4b-4711-a762-49baef4d319c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:08.768318 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-9afe54e6-b3e7-4801-a4dc-0a16884e7034 req-2cc7958c-b60f-425c-80e5-55fbd4f2a779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8865edd3-610c-4338-ae57-746c5b24b8cc", "tag": "23425409-fb84-4741-87bb-e8ae34c58697"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:08.781773 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-9afe54e6-b3e7-4801-a4dc-0a16884e7034 req-2cc7958c-b60f-425c-80e5-55fbd4f2a779 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:08.785428 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-9afe54e6-b3e7-4801-a4dc-0a16884e7034 req-2cc7958c-b60f-425c-80e5-55fbd4f2a779 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:08.811875 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-9afe54e6-b3e7-4801-a4dc-0a16884e7034 req-2cc7958c-b60f-425c-80e5-55fbd4f2a779 service nova] Creating event network-changed:23425409-fb84-4741-87bb-e8ae34c58697 for instance 8865edd3-610c-4338-ae57-746c5b24b8cc on hv-cinder-83998 May 17 22:11:08.819851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-9afe54e6-b3e7-4801-a4dc-0a16884e7034 req-2cc7958c-b60f-425c-80e5-55fbd4f2a779 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055293 May 17 22:11:08.820779 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 135/267] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:11:08.841426 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-554c0281-0f4b-4711-a762-49baef4d319c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:08.856003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-554c0281-0f4b-4711-a762-49baef4d319c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:08.857984 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-554c0281-0f4b-4711-a762-49baef4d319c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:08.859525 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-554c0281-0f4b-4711-a762-49baef4d319c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.229285 May 17 22:11:08.860688 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 133/268] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:08 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:09.403617 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d5e0215f-b147-4272-92e2-9a14fe4ba90d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:09.404219 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d5e0215f-b147-4272-92e2-9a14fe4ba90d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:09.422846 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5e0215f-b147-4272-92e2-9a14fe4ba90d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:09.423532 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5e0215f-b147-4272-92e2-9a14fe4ba90d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:09.424809 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5e0215f-b147-4272-92e2-9a14fe4ba90d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:09.429293 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5e0215f-b147-4272-92e2-9a14fe4ba90d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:09.709669 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d5e0215f-b147-4272-92e2-9a14fe4ba90d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:09.728655 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d5e0215f-b147-4272-92e2-9a14fe4ba90d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.329604 May 17 22:11:09.730843 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 136/269] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:09 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:09.877746 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-34795ea9-79eb-4489-b70c-91e8fc8d0988 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:09.880211 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-34795ea9-79eb-4489-b70c-91e8fc8d0988 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:09.898538 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-34795ea9-79eb-4489-b70c-91e8fc8d0988 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:09.901224 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-34795ea9-79eb-4489-b70c-91e8fc8d0988 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:09.904030 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-34795ea9-79eb-4489-b70c-91e8fc8d0988 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:09.908098 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-34795ea9-79eb-4489-b70c-91e8fc8d0988 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:10.188487 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-34795ea9-79eb-4489-b70c-91e8fc8d0988 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:10.198590 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-34795ea9-79eb-4489-b70c-91e8fc8d0988 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:10.200679 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-34795ea9-79eb-4489-b70c-91e8fc8d0988 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:10.202552 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-34795ea9-79eb-4489-b70c-91e8fc8d0988 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.328006 May 17 22:11:10.213502 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 134/270] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:09 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:10.748744 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ec824b0e-9ed9-4b87-8e33-ace29e2bdb26 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:10.749338 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ec824b0e-9ed9-4b87-8e33-ace29e2bdb26 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:10.764272 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ec824b0e-9ed9-4b87-8e33-ace29e2bdb26 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:10.765006 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ec824b0e-9ed9-4b87-8e33-ace29e2bdb26 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:10.765955 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ec824b0e-9ed9-4b87-8e33-ace29e2bdb26 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:10.766597 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ec824b0e-9ed9-4b87-8e33-ace29e2bdb26 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:11.005676 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ec824b0e-9ed9-4b87-8e33-ace29e2bdb26 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:11.017363 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ec824b0e-9ed9-4b87-8e33-ace29e2bdb26 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.272182 May 17 22:11:11.018667 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 137/271] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:10 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:11.227391 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0c78d8d1-0f6c-4eb3-9606-8fd442d7f588 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:11.229337 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0c78d8d1-0f6c-4eb3-9606-8fd442d7f588 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:11.241889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c78d8d1-0f6c-4eb3-9606-8fd442d7f588 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:11.254398 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c78d8d1-0f6c-4eb3-9606-8fd442d7f588 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:11.254398 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c78d8d1-0f6c-4eb3-9606-8fd442d7f588 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:11.254398 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0c78d8d1-0f6c-4eb3-9606-8fd442d7f588 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:11.480056 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0c78d8d1-0f6c-4eb3-9606-8fd442d7f588 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:11.494407 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0c78d8d1-0f6c-4eb3-9606-8fd442d7f588 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:11.496721 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0c78d8d1-0f6c-4eb3-9606-8fd442d7f588 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:11.498128 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0c78d8d1-0f6c-4eb3-9606-8fd442d7f588 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.279934 May 17 22:11:11.499147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 135/272] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:11 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:11.589519 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1770137386", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b394d145-5e4c-4ff3-9a9e-324cf4600d03"}], "security_groups": [{"name": "tempest-securitygroup--1115697223"}], "key_name": "tempest-keypair-1562254185", "user_data": "}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:11.715687 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] validate_networks() for [('b394d145-5e4c-4ff3-9a9e-324cf4600d03', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:11:12.034855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-02f4f977-1eea-4a5d-8325-23cb2a0ef67e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:12.036403 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-02f4f977-1eea-4a5d-8325-23cb2a0ef67e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:12.053587 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-02f4f977-1eea-4a5d-8325-23cb2a0ef67e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:12.060182 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-02f4f977-1eea-4a5d-8325-23cb2a0ef67e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:12.060182 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-02f4f977-1eea-4a5d-8325-23cb2a0ef67e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:12.060734 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-02f4f977-1eea-4a5d-8325-23cb2a0ef67e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:12.324063 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-02f4f977-1eea-4a5d-8325-23cb2a0ef67e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:12.332546 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-02f4f977-1eea-4a5d-8325-23cb2a0ef67e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.301520 May 17 22:11:12.333592 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 136/273] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:12 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:12.387573 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:11:12.388076 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:11:12.388456 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:11:12.388895 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:11:12.389309 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:11:12.398006 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:12.399049 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:12.399901 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:12.400333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:12.424891 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Getting quotas for project 7a0d6701b5d5441eb7eaf815d273d4d9. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:11:12.428756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Getting quotas for user 8cc69cd4250c436e8b893887604b2273 and project 7a0d6701b5d5441eb7eaf815d273d4d9. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:11:12.440650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:11:12.442925 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:11:12.517230 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-95450de6-793a-4048-9841-8db6692c642a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:12.518076 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-95450de6-793a-4048-9841-8db6692c642a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:12.525484 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-95450de6-793a-4048-9841-8db6692c642a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:12.526187 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-95450de6-793a-4048-9841-8db6692c642a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:12.527230 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-95450de6-793a-4048-9841-8db6692c642a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:12.527742 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-95450de6-793a-4048-9841-8db6692c642a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:12.675576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-95450de6-793a-4048-9841-8db6692c642a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:12.690170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-95450de6-793a-4048-9841-8db6692c642a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:12.691763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-95450de6-793a-4048-9841-8db6692c642a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:12.693041 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-95450de6-793a-4048-9841-8db6692c642a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.179756 May 17 22:11:12.693614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 137/274] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:12 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:12.809411 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d3db94e2-3bdb-43c5-9d62-8f23de19c8ce tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.224133 May 17 22:11:12.813674 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 138/275] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:11:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:11:12.825103 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-785b71ba-28aa-406a-a0c1-f1bf5c3f8586 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:12.825935 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-785b71ba-28aa-406a-a0c1-f1bf5c3f8586 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:12.916436 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-785b71ba-28aa-406a-a0c1-f1bf5c3f8586 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:12.928123 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-785b71ba-28aa-406a-a0c1-f1bf5c3f8586 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1246 microversion: 2.1 time: 0.108238 May 17 22:11:12.929453 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 138/276] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:12 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1246 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:13.350745 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cc65e67c-dcc6-4051-a9f2-2fce5ce67367 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:13.351385 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cc65e67c-dcc6-4051-a9f2-2fce5ce67367 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:13.362916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cc65e67c-dcc6-4051-a9f2-2fce5ce67367 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:13.363709 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cc65e67c-dcc6-4051-a9f2-2fce5ce67367 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:13.364666 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cc65e67c-dcc6-4051-a9f2-2fce5ce67367 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:13.365982 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cc65e67c-dcc6-4051-a9f2-2fce5ce67367 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:13.546038 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cc65e67c-dcc6-4051-a9f2-2fce5ce67367 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:13.554172 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cc65e67c-dcc6-4051-a9f2-2fce5ce67367 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.207631 May 17 22:11:13.555353 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 139/277] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:13 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:13.713601 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-377a6c18-c525-49f4-aaa4-7fd3726f706c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:13.714334 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-377a6c18-c525-49f4-aaa4-7fd3726f706c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:13.726083 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-377a6c18-c525-49f4-aaa4-7fd3726f706c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:13.728330 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-377a6c18-c525-49f4-aaa4-7fd3726f706c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:13.729429 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-377a6c18-c525-49f4-aaa4-7fd3726f706c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:13.730635 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-377a6c18-c525-49f4-aaa4-7fd3726f706c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:13.954826 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-377a6c18-c525-49f4-aaa4-7fd3726f706c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:13.958486 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8f06665f-9127-4fd5-b268-9c5e1c57ecc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:13.959283 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8f06665f-9127-4fd5-b268-9c5e1c57ecc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:13.970157 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f06665f-9127-4fd5-b268-9c5e1c57ecc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:13.970429 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-377a6c18-c525-49f4-aaa4-7fd3726f706c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:13.970869 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f06665f-9127-4fd5-b268-9c5e1c57ecc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:13.971743 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f06665f-9127-4fd5-b268-9c5e1c57ecc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:13.972178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f06665f-9127-4fd5-b268-9c5e1c57ecc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:13.972774 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-377a6c18-c525-49f4-aaa4-7fd3726f706c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:13.974210 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-377a6c18-c525-49f4-aaa4-7fd3726f706c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.267718 May 17 22:11:13.975213 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 139/278] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:13 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:13.987096 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-35c2f219-c5e7-4713-b5af-3dde682dd3ec tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: .version_select at 0x7f09f228b040>, body: {"keypair": {"name": "tempest-keypair-1015142436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2V4/fI/elKo2N96MBXseRdx4EX5a6ZD+RBt6JkFQawJM8esoBb7dpYtUOKkZyBusR67mjmmX7TdXyQcikngL981lfcQ1K8qad2bkLTiIu69FqWN6h8lFcYzkY+zsytaw=="}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:14.002149 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-35c2f219-c5e7-4713-b5af-3dde682dd3ec tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for project ea0809b61be446a69359b69b50b61710. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:11:14.006421 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-35c2f219-c5e7-4713-b5af-3dde682dd3ec tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for user 4bbb6a0a08464e738ef0d062dfe87182 and project ea0809b61be446a69359b69b50b61710. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:11:14.090270 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8f06665f-9127-4fd5-b268-9c5e1c57ecc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:14.098777 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8f06665f-9127-4fd5-b268-9c5e1c57ecc6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1250 microversion: 2.1 time: 0.156448 May 17 22:11:14.108682 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 140/279] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:13 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1250 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:14.229124 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-35c2f219-c5e7-4713-b5af-3dde682dd3ec tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.246711 May 17 22:11:14.235060 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 140/280] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 17 22:11:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:11:14.573053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-29ae8e10-8b0c-4126-b6f3-c31096955771 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:14.573651 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-29ae8e10-8b0c-4126-b6f3-c31096955771 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:14.582121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-29ae8e10-8b0c-4126-b6f3-c31096955771 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:14.582559 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-29ae8e10-8b0c-4126-b6f3-c31096955771 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:14.583571 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-29ae8e10-8b0c-4126-b6f3-c31096955771 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:14.584148 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-29ae8e10-8b0c-4126-b6f3-c31096955771 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:14.803147 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-29ae8e10-8b0c-4126-b6f3-c31096955771 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:14.813868 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-29ae8e10-8b0c-4126-b6f3-c31096955771 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.245123 May 17 22:11:14.814550 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 141/281] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:14 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:15.007689 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-477505ea-53a5-465d-bc74-a2e40550d873 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:15.009564 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-477505ea-53a5-465d-bc74-a2e40550d873 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:15.025615 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-477505ea-53a5-465d-bc74-a2e40550d873 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:15.030964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-477505ea-53a5-465d-bc74-a2e40550d873 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:15.031902 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-477505ea-53a5-465d-bc74-a2e40550d873 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:15.032464 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-477505ea-53a5-465d-bc74-a2e40550d873 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:15.116863 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-707a99f3-a2e3-466e-acd0-47a5cd164acb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:15.118360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-707a99f3-a2e3-466e-acd0-47a5cd164acb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:15.133919 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-707a99f3-a2e3-466e-acd0-47a5cd164acb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:15.134914 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-707a99f3-a2e3-466e-acd0-47a5cd164acb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:15.136117 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-707a99f3-a2e3-466e-acd0-47a5cd164acb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:15.136990 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-707a99f3-a2e3-466e-acd0-47a5cd164acb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:15.233238 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-707a99f3-a2e3-466e-acd0-47a5cd164acb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:15.236545 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-477505ea-53a5-465d-bc74-a2e40550d873 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:15.242181 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-707a99f3-a2e3-466e-acd0-47a5cd164acb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1298 microversion: 2.1 time: 0.129722 May 17 22:11:15.244596 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 142/282] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:15 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1298 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:15.248637 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-477505ea-53a5-465d-bc74-a2e40550d873 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:15.250569 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-477505ea-53a5-465d-bc74-a2e40550d873 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:15.252635 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-477505ea-53a5-465d-bc74-a2e40550d873 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.256706 May 17 22:11:15.264913 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 141/283] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:14 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:15.831857 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-496313af-fd9a-4829-a98a-ee84cf00b06b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:15.835290 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-496313af-fd9a-4829-a98a-ee84cf00b06b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:15.842694 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-496313af-fd9a-4829-a98a-ee84cf00b06b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:15.846179 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-496313af-fd9a-4829-a98a-ee84cf00b06b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:15.848298 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-496313af-fd9a-4829-a98a-ee84cf00b06b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:15.854522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-496313af-fd9a-4829-a98a-ee84cf00b06b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:16.264430 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d0e3a9cb-5806-41a1-b958-fc54ad9b4487 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:16.266404 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d0e3a9cb-5806-41a1-b958-fc54ad9b4487 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:16.291431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0e3a9cb-5806-41a1-b958-fc54ad9b4487 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:16.292270 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0e3a9cb-5806-41a1-b958-fc54ad9b4487 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:16.293516 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0e3a9cb-5806-41a1-b958-fc54ad9b4487 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:16.294167 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0e3a9cb-5806-41a1-b958-fc54ad9b4487 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:16.463965 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d0e3a9cb-5806-41a1-b958-fc54ad9b4487 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:16.471775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d0e3a9cb-5806-41a1-b958-fc54ad9b4487 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1304 microversion: 2.1 time: 0.213878 May 17 22:11:16.472356 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 142/284] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:16 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1304 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:16.484864 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2019e36c-4116-4f4a-8bdc-6b351cbcb42b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:16.486384 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2019e36c-4116-4f4a-8bdc-6b351cbcb42b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:16.496512 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2019e36c-4116-4f4a-8bdc-6b351cbcb42b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:16.496976 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2019e36c-4116-4f4a-8bdc-6b351cbcb42b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:16.497796 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2019e36c-4116-4f4a-8bdc-6b351cbcb42b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:16.498243 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2019e36c-4116-4f4a-8bdc-6b351cbcb42b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:16.530628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-496313af-fd9a-4829-a98a-ee84cf00b06b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:16.539590 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-496313af-fd9a-4829-a98a-ee84cf00b06b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.711654 May 17 22:11:16.543137 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 143/285] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:15 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:16.712481 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2019e36c-4116-4f4a-8bdc-6b351cbcb42b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:16.720405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2019e36c-4116-4f4a-8bdc-6b351cbcb42b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:16.721956 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2019e36c-4116-4f4a-8bdc-6b351cbcb42b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:16.723144 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2019e36c-4116-4f4a-8bdc-6b351cbcb42b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.249619 May 17 22:11:16.723705 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 143/286] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:16 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:17.266572 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-2372e4fe-72bb-4d7d-a2e7-b8403e5aa65d req-30a20fc8-8345-483c-b031-a5f880b90e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8865edd3-610c-4338-ae57-746c5b24b8cc", "name": "network-vif-plugged", "status": "completed", "tag": "23425409-fb84-4741-87bb-e8ae34c58697"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:17.282332 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-2372e4fe-72bb-4d7d-a2e7-b8403e5aa65d req-30a20fc8-8345-483c-b031-a5f880b90e56 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:17.282846 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-2372e4fe-72bb-4d7d-a2e7-b8403e5aa65d req-30a20fc8-8345-483c-b031-a5f880b90e56 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:17.300494 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-2372e4fe-72bb-4d7d-a2e7-b8403e5aa65d req-30a20fc8-8345-483c-b031-a5f880b90e56 service nova] Creating event network-vif-plugged:23425409-fb84-4741-87bb-e8ae34c58697 for instance 8865edd3-610c-4338-ae57-746c5b24b8cc on hv-cinder-83998 May 17 22:11:17.308080 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-2372e4fe-72bb-4d7d-a2e7-b8403e5aa65d req-30a20fc8-8345-483c-b031-a5f880b90e56 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051107 May 17 22:11:17.312899 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 144/287] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:11:17.489021 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c545c00d-a1b7-4cb0-9127-ae432ef6e62c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:17.489613 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c545c00d-a1b7-4cb0-9127-ae432ef6e62c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:17.503605 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c545c00d-a1b7-4cb0-9127-ae432ef6e62c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:17.504242 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c545c00d-a1b7-4cb0-9127-ae432ef6e62c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:17.505302 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c545c00d-a1b7-4cb0-9127-ae432ef6e62c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:17.505916 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c545c00d-a1b7-4cb0-9127-ae432ef6e62c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:17.560172 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-938fa2b9-b609-45f5-9ebb-d8261d9554d9 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:17.562714 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-938fa2b9-b609-45f5-9ebb-d8261d9554d9 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:17.578532 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-938fa2b9-b609-45f5-9ebb-d8261d9554d9 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:17.582636 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-938fa2b9-b609-45f5-9ebb-d8261d9554d9 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:17.583628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-938fa2b9-b609-45f5-9ebb-d8261d9554d9 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:17.584200 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-938fa2b9-b609-45f5-9ebb-d8261d9554d9 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:17.763085 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c545c00d-a1b7-4cb0-9127-ae432ef6e62c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:17.770297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c545c00d-a1b7-4cb0-9127-ae432ef6e62c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.285285 May 17 22:11:17.770862 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 144/288] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:17 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:17.776093 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8f7d1349-659a-415c-9172-86338c895054 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:17.776713 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8f7d1349-659a-415c-9172-86338c895054 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:17.782897 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f7d1349-659a-415c-9172-86338c895054 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:17.783387 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f7d1349-659a-415c-9172-86338c895054 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:17.784156 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f7d1349-659a-415c-9172-86338c895054 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:17.784601 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f7d1349-659a-415c-9172-86338c895054 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:17.805542 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-938fa2b9-b609-45f5-9ebb-d8261d9554d9 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:17.813892 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-938fa2b9-b609-45f5-9ebb-d8261d9554d9 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.260353 May 17 22:11:17.814466 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 145/289] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:17 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:17.993725 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8f7d1349-659a-415c-9172-86338c895054 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:18.002554 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8f7d1349-659a-415c-9172-86338c895054 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:18.004083 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8f7d1349-659a-415c-9172-86338c895054 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:18.005438 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8f7d1349-659a-415c-9172-86338c895054 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.233462 May 17 22:11:18.006019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 145/290] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:17 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:18.169688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-790800540", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f877e2b-99bd-48e8-8b73-18e37441b914"}], "security_groups": [{"name": "tempest-securitygroup--83170986"}], "key_name": "tempest-keypair-1015142436", "user_data": "}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:18.193527 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ed812e24-cd8b-452e-b22b-63dad84a4897 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Action: 'create', calling method: .version_select at 0x7f09f22980d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-208810577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIl6d4dh2E3WDPAG9fjUXM3D3CWFpU479fDP09RTEgKxY8gRhB5y05dtQe+Ba89tv1Ppz9hygBrAMyHiNrUeAlu4dT46u0+vMr7112L5TVvFJvH+9I4ZlZvm1MwR81eDCQ=="}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:18.207527 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-ed812e24-cd8b-452e-b22b-63dad84a4897 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Getting quotas for project f3b9176d44ed415bacfaf45f3f8472a5. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:11:18.211689 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-ed812e24-cd8b-452e-b22b-63dad84a4897 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Getting quotas for user b1ef9ab26a7442479ec952d43e392081 and project f3b9176d44ed415bacfaf45f3f8472a5. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:11:18.278765 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] validate_networks() for [('6f877e2b-99bd-48e8-8b73-18e37441b914', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:11:18.316971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ed812e24-cd8b-452e-b22b-63dad84a4897 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.126804 May 17 22:11:18.317518 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 146/291] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 17 22:11:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:11:18.440356 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-18356219", "imageRef": "58c7e0e6-76dd-4652-b852-aa7b74a558f3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-208810577", "networks": [{"uuid": "9e8f2a1e-5f6c-4b1b-8e8e-be823432c2fb"}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:18.500135 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] validate_networks() for [('9e8f2a1e-5f6c-4b1b-8e8e-be823432c2fb', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:11:18.901285 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:11:18.901900 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:11:18.902563 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:11:18.903178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:11:18.903434 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:11:18.912906 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:18.913353 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:18.915072 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:18.916677 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:18.935052 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for project ea0809b61be446a69359b69b50b61710. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:11:18.939805 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for user 4bbb6a0a08464e738ef0d062dfe87182 and project ea0809b61be446a69359b69b50b61710. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:11:18.953782 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:11:18.960225 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:11:19.089123 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:11:19.089619 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:11:19.090364 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:11:19.090771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:11:19.091204 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:11:19.099935 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:19.100374 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:19.101162 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:19.101653 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:19.117803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Getting quotas for project f3b9176d44ed415bacfaf45f3f8472a5. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:11:19.122078 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Getting quotas for user b1ef9ab26a7442479ec952d43e392081 and project f3b9176d44ed415bacfaf45f3f8472a5. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:11:19.127288 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-27124bb7-f8d1-4483-9815-eafa4e1e4848 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.962267 May 17 22:11:19.127933 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 146/292] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:11:18 2022] POST /compute/v2.1/servers => generated 400 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:11:19.133484 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f6aa03c8-33e3-4aae-b49a-a8ff17c22716 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:19.134330 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f6aa03c8-33e3-4aae-b49a-a8ff17c22716 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:19.137465 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:11:19.139718 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58c7e0e6-76dd-4652-b852-aa7b74a558f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:11:19.140570 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f6aa03c8-33e3-4aae-b49a-a8ff17c22716 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:19.152460 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f6aa03c8-33e3-4aae-b49a-a8ff17c22716 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:19.153539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f6aa03c8-33e3-4aae-b49a-a8ff17c22716 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:19.154200 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f6aa03c8-33e3-4aae-b49a-a8ff17c22716 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:19.307797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f6aa03c8-33e3-4aae-b49a-a8ff17c22716 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:19.318138 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f6aa03c8-33e3-4aae-b49a-a8ff17c22716 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.188880 May 17 22:11:19.318729 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 147/293] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:19 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:19.329193 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ad443551-4658-49f5-a0f3-99de9766e342 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894871 May 17 22:11:19.333760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fb654f6c-03d6-489d-92ec-6712a9496af4 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:19.334365 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fb654f6c-03d6-489d-92ec-6712a9496af4 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:19.338131 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 147/294] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:11:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 22:11:19.342101 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fb654f6c-03d6-489d-92ec-6712a9496af4 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:19.342537 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fb654f6c-03d6-489d-92ec-6712a9496af4 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:19.343676 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fb654f6c-03d6-489d-92ec-6712a9496af4 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:19.343776 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fb654f6c-03d6-489d-92ec-6712a9496af4 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:19.348696 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-caee26cb-a04e-4d71-9bd5-851a08acbdf4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:19.349529 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-caee26cb-a04e-4d71-9bd5-851a08acbdf4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:19.361188 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-caee26cb-a04e-4d71-9bd5-851a08acbdf4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:19.361731 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-caee26cb-a04e-4d71-9bd5-851a08acbdf4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:19.363366 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-caee26cb-a04e-4d71-9bd5-851a08acbdf4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:19.364015 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-caee26cb-a04e-4d71-9bd5-851a08acbdf4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:19.556302 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fb654f6c-03d6-489d-92ec-6712a9496af4 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:19.562781 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-caee26cb-a04e-4d71-9bd5-851a08acbdf4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:19.566196 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fb654f6c-03d6-489d-92ec-6712a9496af4 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.236331 May 17 22:11:19.566987 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 148/295] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:19 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:19.571843 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f391cd9d-665a-4972-9145-062fbbfe75d4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:19.581172 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f391cd9d-665a-4972-9145-062fbbfe75d4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:19.582277 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-caee26cb-a04e-4d71-9bd5-851a08acbdf4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:19.583921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-caee26cb-a04e-4d71-9bd5-851a08acbdf4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:19.585462 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-caee26cb-a04e-4d71-9bd5-851a08acbdf4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.245970 May 17 22:11:19.596353 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 148/296] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:19 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:19.596353 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-670443e6-94aa-40e3-b48d-6a53ce2a7f98 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:19.596353 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-670443e6-94aa-40e3-b48d-6a53ce2a7f98 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:19.640115 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f391cd9d-665a-4972-9145-062fbbfe75d4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:19.646787 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f391cd9d-665a-4972-9145-062fbbfe75d4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1241 microversion: 2.1 time: 0.078467 May 17 22:11:19.647460 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 149/297] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:19 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:19.667675 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-670443e6-94aa-40e3-b48d-6a53ce2a7f98 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:19.674545 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-670443e6-94aa-40e3-b48d-6a53ce2a7f98 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1256 microversion: 2.1 time: 0.086077 May 17 22:11:19.675168 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 149/298] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:19 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1256 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:20.149717 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-9cb917e9-6158-4ac2-b223-6bbbe25dfb37 req-08883c99-56df-4125-83ff-a53e1055138d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3e521e-c843-4727-8c31-00c86e4e6aa0", "tag": "ea82fbfe-827c-4d08-a78d-a544d7f86c1c"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:20.157977 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-9cb917e9-6158-4ac2-b223-6bbbe25dfb37 req-08883c99-56df-4125-83ff-a53e1055138d service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:20.158498 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-9cb917e9-6158-4ac2-b223-6bbbe25dfb37 req-08883c99-56df-4125-83ff-a53e1055138d service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:20.171238 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-9cb917e9-6158-4ac2-b223-6bbbe25dfb37 req-08883c99-56df-4125-83ff-a53e1055138d service nova] Creating event network-changed:ea82fbfe-827c-4d08-a78d-a544d7f86c1c for instance da3e521e-c843-4727-8c31-00c86e4e6aa0 on hv-cinder-83998 May 17 22:11:20.176407 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-9cb917e9-6158-4ac2-b223-6bbbe25dfb37 req-08883c99-56df-4125-83ff-a53e1055138d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031404 May 17 22:11:20.177570 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 150/299] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:11:20.337215 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3afa9877-3662-4457-b4dd-c13b3c70937e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:20.340773 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3afa9877-3662-4457-b4dd-c13b3c70937e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:20.344467 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3afa9877-3662-4457-b4dd-c13b3c70937e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:20.349152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3afa9877-3662-4457-b4dd-c13b3c70937e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:20.349152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3afa9877-3662-4457-b4dd-c13b3c70937e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:20.349152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3afa9877-3662-4457-b4dd-c13b3c70937e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:20.479992 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3afa9877-3662-4457-b4dd-c13b3c70937e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:20.487612 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3afa9877-3662-4457-b4dd-c13b3c70937e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.155687 May 17 22:11:20.488178 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 150/300] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:20 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:20.583530 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3d22f2aa-4193-4b78-b080-4c5863737e79 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:20.584850 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3d22f2aa-4193-4b78-b080-4c5863737e79 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:20.591140 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d22f2aa-4193-4b78-b080-4c5863737e79 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:20.591587 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d22f2aa-4193-4b78-b080-4c5863737e79 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:20.592348 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d22f2aa-4193-4b78-b080-4c5863737e79 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:20.592774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d22f2aa-4193-4b78-b080-4c5863737e79 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:20.604684 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f08e925f-0cb2-4333-a866-63ca4886349d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:20.605383 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f08e925f-0cb2-4333-a866-63ca4886349d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:20.611788 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f08e925f-0cb2-4333-a866-63ca4886349d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:20.612236 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f08e925f-0cb2-4333-a866-63ca4886349d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:20.613011 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f08e925f-0cb2-4333-a866-63ca4886349d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:20.613482 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f08e925f-0cb2-4333-a866-63ca4886349d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:20.789748 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3d22f2aa-4193-4b78-b080-4c5863737e79 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:20.796297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f08e925f-0cb2-4333-a866-63ca4886349d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:20.797321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3d22f2aa-4193-4b78-b080-4c5863737e79 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.218567 May 17 22:11:20.797969 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 151/301] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:20 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:20.802397 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5c9ea40b-7049-4ec4-a01b-93f3c8bfa055 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:20.803092 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5c9ea40b-7049-4ec4-a01b-93f3c8bfa055 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:20.808060 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f08e925f-0cb2-4333-a866-63ca4886349d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:20.809327 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c9ea40b-7049-4ec4-a01b-93f3c8bfa055 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:20.809777 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c9ea40b-7049-4ec4-a01b-93f3c8bfa055 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:20.809925 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f08e925f-0cb2-4333-a866-63ca4886349d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:20.810534 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c9ea40b-7049-4ec4-a01b-93f3c8bfa055 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:20.810965 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c9ea40b-7049-4ec4-a01b-93f3c8bfa055 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:20.811065 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f08e925f-0cb2-4333-a866-63ca4886349d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.210940 May 17 22:11:20.811578 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 151/302] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:20 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:11:20.815833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b3d49c3c-f953-47dd-89c1-b0ce44fe3b28 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:20.816607 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b3d49c3c-f953-47dd-89c1-b0ce44fe3b28 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:20.826099 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b3d49c3c-f953-47dd-89c1-b0ce44fe3b28 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:20.826541 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b3d49c3c-f953-47dd-89c1-b0ce44fe3b28 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:20.827364 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b3d49c3c-f953-47dd-89c1-b0ce44fe3b28 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:20.827781 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b3d49c3c-f953-47dd-89c1-b0ce44fe3b28 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:20.878544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5c9ea40b-7049-4ec4-a01b-93f3c8bfa055 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:20.886123 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5c9ea40b-7049-4ec4-a01b-93f3c8bfa055 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1245 microversion: 2.1 time: 0.087111 May 17 22:11:20.886697 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 152/303] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:20 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:20.897744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b3d49c3c-f953-47dd-89c1-b0ce44fe3b28 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:20.906210 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b3d49c3c-f953-47dd-89c1-b0ce44fe3b28 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1260 microversion: 2.1 time: 0.093709 May 17 22:11:20.908190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 152/304] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:20 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1260 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:21.504553 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c6435d4f-1a4d-419c-9952-5bacdf36b765 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:21.505167 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c6435d4f-1a4d-419c-9952-5bacdf36b765 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:21.511793 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6435d4f-1a4d-419c-9952-5bacdf36b765 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:21.512244 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6435d4f-1a4d-419c-9952-5bacdf36b765 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:21.513014 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6435d4f-1a4d-419c-9952-5bacdf36b765 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:21.513452 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c6435d4f-1a4d-419c-9952-5bacdf36b765 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:21.639639 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c6435d4f-1a4d-419c-9952-5bacdf36b765 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:21.647176 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c6435d4f-1a4d-419c-9952-5bacdf36b765 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.146305 May 17 22:11:21.647678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 153/305] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:21 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:21.814746 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e9bb581c-bd0e-4a59-a72d-4066b5ebbd49 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:21.815371 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e9bb581c-bd0e-4a59-a72d-4066b5ebbd49 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:21.821852 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e9bb581c-bd0e-4a59-a72d-4066b5ebbd49 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:21.822306 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e9bb581c-bd0e-4a59-a72d-4066b5ebbd49 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:21.823770 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e9bb581c-bd0e-4a59-a72d-4066b5ebbd49 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:21.824167 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e9bb581c-bd0e-4a59-a72d-4066b5ebbd49 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:21.829539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9bacebea-ad45-4c04-a9e9-69c9274c062a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:21.830391 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9bacebea-ad45-4c04-a9e9-69c9274c062a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:21.836318 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9bacebea-ad45-4c04-a9e9-69c9274c062a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:21.836768 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9bacebea-ad45-4c04-a9e9-69c9274c062a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:21.837538 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9bacebea-ad45-4c04-a9e9-69c9274c062a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:21.837974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9bacebea-ad45-4c04-a9e9-69c9274c062a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:22.017498 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e9bb581c-bd0e-4a59-a72d-4066b5ebbd49 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:22.024698 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e9bb581c-bd0e-4a59-a72d-4066b5ebbd49 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.213722 May 17 22:11:22.025400 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 153/306] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:21 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:22.027997 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9bacebea-ad45-4c04-a9e9-69c9274c062a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:22.030391 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9a99b446-326c-4454-aa87-e930091abbc8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:22.030989 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9a99b446-326c-4454-aa87-e930091abbc8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:22.036186 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9bacebea-ad45-4c04-a9e9-69c9274c062a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:22.037272 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a99b446-326c-4454-aa87-e930091abbc8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:22.037749 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a99b446-326c-4454-aa87-e930091abbc8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:22.037855 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9bacebea-ad45-4c04-a9e9-69c9274c062a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:22.038514 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a99b446-326c-4454-aa87-e930091abbc8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:22.038989 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9a99b446-326c-4454-aa87-e930091abbc8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:22.039282 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9bacebea-ad45-4c04-a9e9-69c9274c062a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.213487 May 17 22:11:22.045645 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 154/307] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:21 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:11:22.045645 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1a2b73d3-2f1e-4b57-9603-acc7d8777cbc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:22.045825 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1a2b73d3-2f1e-4b57-9603-acc7d8777cbc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:22.054085 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a2b73d3-2f1e-4b57-9603-acc7d8777cbc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:22.054534 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a2b73d3-2f1e-4b57-9603-acc7d8777cbc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:22.055909 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a2b73d3-2f1e-4b57-9603-acc7d8777cbc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:22.055909 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a2b73d3-2f1e-4b57-9603-acc7d8777cbc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:22.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9a99b446-326c-4454-aa87-e930091abbc8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:22.142990 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1a2b73d3-2f1e-4b57-9603-acc7d8777cbc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:22.149992 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9a99b446-326c-4454-aa87-e930091abbc8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1245 microversion: 2.1 time: 0.123550 May 17 22:11:22.150639 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1a2b73d3-2f1e-4b57-9603-acc7d8777cbc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1260 microversion: 2.1 time: 0.109721 May 17 22:11:22.151291 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 154/308] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:22 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:22.158505 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 155/309] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:22 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1260 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:22.665519 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-76fac434-2fca-48e3-b0c1-b8c94ec419eb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:22.666204 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-76fac434-2fca-48e3-b0c1-b8c94ec419eb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:22.673613 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76fac434-2fca-48e3-b0c1-b8c94ec419eb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:22.674066 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76fac434-2fca-48e3-b0c1-b8c94ec419eb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:22.674843 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76fac434-2fca-48e3-b0c1-b8c94ec419eb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:22.675424 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76fac434-2fca-48e3-b0c1-b8c94ec419eb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:22.804943 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-76fac434-2fca-48e3-b0c1-b8c94ec419eb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:22.813763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-76fac434-2fca-48e3-b0c1-b8c94ec419eb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.152252 May 17 22:11:22.819831 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 155/310] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:22 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:23.041955 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b5abf5a4-665b-4506-9065-7bdccf9c4b4e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:23.042570 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b5abf5a4-665b-4506-9065-7bdccf9c4b4e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:23.048836 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5abf5a4-665b-4506-9065-7bdccf9c4b4e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:23.049277 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5abf5a4-665b-4506-9065-7bdccf9c4b4e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:23.050026 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5abf5a4-665b-4506-9065-7bdccf9c4b4e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:23.050452 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5abf5a4-665b-4506-9065-7bdccf9c4b4e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:23.062637 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-09ef4491-3cde-46e2-afee-32149787d467 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:23.063300 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-09ef4491-3cde-46e2-afee-32149787d467 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:23.069848 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09ef4491-3cde-46e2-afee-32149787d467 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:23.070297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09ef4491-3cde-46e2-afee-32149787d467 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:23.071078 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09ef4491-3cde-46e2-afee-32149787d467 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:23.071540 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-09ef4491-3cde-46e2-afee-32149787d467 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:23.249515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b5abf5a4-665b-4506-9065-7bdccf9c4b4e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:23.252817 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-09ef4491-3cde-46e2-afee-32149787d467 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:23.257875 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b5abf5a4-665b-4506-9065-7bdccf9c4b4e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.219813 May 17 22:11:23.258691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 156/311] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:23 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:23.264197 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f2efe9db-b0cc-4331-b4da-82af035dc2ff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:23.265024 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f2efe9db-b0cc-4331-b4da-82af035dc2ff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:23.266482 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-09ef4491-3cde-46e2-afee-32149787d467 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:23.268207 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-09ef4491-3cde-46e2-afee-32149787d467 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:23.269374 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-09ef4491-3cde-46e2-afee-32149787d467 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.210970 May 17 22:11:23.269932 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 156/312] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:23 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:11:23.271092 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2efe9db-b0cc-4331-b4da-82af035dc2ff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:23.271563 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2efe9db-b0cc-4331-b4da-82af035dc2ff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:23.272321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2efe9db-b0cc-4331-b4da-82af035dc2ff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:23.272748 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2efe9db-b0cc-4331-b4da-82af035dc2ff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:23.275326 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-19d43fdf-ed97-4a14-9b48-b8977fedac0a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:23.276183 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-19d43fdf-ed97-4a14-9b48-b8977fedac0a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:23.281974 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-19d43fdf-ed97-4a14-9b48-b8977fedac0a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:23.282426 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-19d43fdf-ed97-4a14-9b48-b8977fedac0a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:23.283227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-19d43fdf-ed97-4a14-9b48-b8977fedac0a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:23.283671 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-19d43fdf-ed97-4a14-9b48-b8977fedac0a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:23.346883 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f2efe9db-b0cc-4331-b4da-82af035dc2ff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:23.355035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f2efe9db-b0cc-4331-b4da-82af035dc2ff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1237 microversion: 2.1 time: 0.094519 May 17 22:11:23.355625 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 157/313] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:23 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:23.362261 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-19d43fdf-ed97-4a14-9b48-b8977fedac0a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:23.369851 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-19d43fdf-ed97-4a14-9b48-b8977fedac0a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1252 microversion: 2.1 time: 0.098557 May 17 22:11:23.370414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 157/314] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:23 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1252 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:23.830867 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-97287001-2681-4318-9a12-52a888add24f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:23.831507 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-97287001-2681-4318-9a12-52a888add24f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:23.837413 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-97287001-2681-4318-9a12-52a888add24f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:23.837859 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-97287001-2681-4318-9a12-52a888add24f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:23.838679 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-97287001-2681-4318-9a12-52a888add24f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:23.839131 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-97287001-2681-4318-9a12-52a888add24f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:23.967953 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-97287001-2681-4318-9a12-52a888add24f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:23.975130 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-97287001-2681-4318-9a12-52a888add24f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.148098 May 17 22:11:23.975734 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 158/315] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:23 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:24.274977 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f2b8b8a3-c05a-419a-a90b-bbb2448e9ffc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:24.275708 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f2b8b8a3-c05a-419a-a90b-bbb2448e9ffc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:24.282229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f2b8b8a3-c05a-419a-a90b-bbb2448e9ffc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:24.282757 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f2b8b8a3-c05a-419a-a90b-bbb2448e9ffc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:24.283568 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f2b8b8a3-c05a-419a-a90b-bbb2448e9ffc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:24.284007 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f2b8b8a3-c05a-419a-a90b-bbb2448e9ffc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:24.287227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-254aa52c-4061-4af0-a9ed-05639b835770 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:24.289204 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-254aa52c-4061-4af0-a9ed-05639b835770 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:24.295206 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-254aa52c-4061-4af0-a9ed-05639b835770 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:24.297157 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-254aa52c-4061-4af0-a9ed-05639b835770 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:24.297157 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-254aa52c-4061-4af0-a9ed-05639b835770 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:24.297157 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-254aa52c-4061-4af0-a9ed-05639b835770 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:24.477612 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f2b8b8a3-c05a-419a-a90b-bbb2448e9ffc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:24.481290 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-254aa52c-4061-4af0-a9ed-05639b835770 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:24.485880 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f2b8b8a3-c05a-419a-a90b-bbb2448e9ffc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.214688 May 17 22:11:24.486534 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 158/316] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:24 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:24.489522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-254aa52c-4061-4af0-a9ed-05639b835770 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:24.491010 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c497effd-c2fe-47e5-a6ef-e7a847220ff1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:24.491169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-254aa52c-4061-4af0-a9ed-05639b835770 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:24.491735 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c497effd-c2fe-47e5-a6ef-e7a847220ff1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:24.492233 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-254aa52c-4061-4af0-a9ed-05639b835770 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.209245 May 17 22:11:24.497092 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 159/317] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:24 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:24.497973 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c497effd-c2fe-47e5-a6ef-e7a847220ff1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:24.498525 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c497effd-c2fe-47e5-a6ef-e7a847220ff1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:24.499433 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c497effd-c2fe-47e5-a6ef-e7a847220ff1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:24.499970 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c497effd-c2fe-47e5-a6ef-e7a847220ff1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:24.501805 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3d6949a5-b419-4256-a074-02289ba77800 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:24.502495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3d6949a5-b419-4256-a074-02289ba77800 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:24.508406 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d6949a5-b419-4256-a074-02289ba77800 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:24.508884 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d6949a5-b419-4256-a074-02289ba77800 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:24.509602 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d6949a5-b419-4256-a074-02289ba77800 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:24.510036 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d6949a5-b419-4256-a074-02289ba77800 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:24.568290 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c497effd-c2fe-47e5-a6ef-e7a847220ff1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:24.575989 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c497effd-c2fe-47e5-a6ef-e7a847220ff1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1237 microversion: 2.1 time: 0.088436 May 17 22:11:24.576740 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 159/318] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:24 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:24.584380 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3d6949a5-b419-4256-a074-02289ba77800 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:24.592259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3d6949a5-b419-4256-a074-02289ba77800 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1252 microversion: 2.1 time: 0.098524 May 17 22:11:24.594777 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 160/319] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:24 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1252 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:24.991943 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-db99bf9e-3072-454f-8c8f-0fa2216789d3 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:24.992549 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-db99bf9e-3072-454f-8c8f-0fa2216789d3 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:24.998555 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db99bf9e-3072-454f-8c8f-0fa2216789d3 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:24.999004 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db99bf9e-3072-454f-8c8f-0fa2216789d3 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:24.999798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db99bf9e-3072-454f-8c8f-0fa2216789d3 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:25.000233 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db99bf9e-3072-454f-8c8f-0fa2216789d3 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:25.166279 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db99bf9e-3072-454f-8c8f-0fa2216789d3 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:25.174065 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-db99bf9e-3072-454f-8c8f-0fa2216789d3 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.185988 May 17 22:11:25.176530 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 160/320] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:24 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:25.502955 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8a7d358c-39f6-408e-a902-2769fe8fdb87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:25.503585 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8a7d358c-39f6-408e-a902-2769fe8fdb87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:25.510132 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-db87cac0-eba0-4b72-b6cb-3148a39d55e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:25.511157 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8a7d358c-39f6-408e-a902-2769fe8fdb87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:25.511157 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8a7d358c-39f6-408e-a902-2769fe8fdb87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:25.511408 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-db87cac0-eba0-4b72-b6cb-3148a39d55e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:25.512099 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8a7d358c-39f6-408e-a902-2769fe8fdb87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:25.512538 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8a7d358c-39f6-408e-a902-2769fe8fdb87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:25.517951 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db87cac0-eba0-4b72-b6cb-3148a39d55e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:25.518395 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db87cac0-eba0-4b72-b6cb-3148a39d55e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:25.519507 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db87cac0-eba0-4b72-b6cb-3148a39d55e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:25.520097 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db87cac0-eba0-4b72-b6cb-3148a39d55e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:25.703073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8a7d358c-39f6-408e-a902-2769fe8fdb87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:25.710050 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db87cac0-eba0-4b72-b6cb-3148a39d55e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:25.711284 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8a7d358c-39f6-408e-a902-2769fe8fdb87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.212157 May 17 22:11:25.711960 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 161/321] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:25 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:25.717236 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-75e048e5-ab23-4a6a-9b61-1ccbab4528f1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:25.718144 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-75e048e5-ab23-4a6a-9b61-1ccbab4528f1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:25.718644 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db87cac0-eba0-4b72-b6cb-3148a39d55e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:25.720378 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db87cac0-eba0-4b72-b6cb-3148a39d55e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:25.721714 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-db87cac0-eba0-4b72-b6cb-3148a39d55e9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.215705 May 17 22:11:25.722440 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 161/322] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:25 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:25.724937 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75e048e5-ab23-4a6a-9b61-1ccbab4528f1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:25.725462 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75e048e5-ab23-4a6a-9b61-1ccbab4528f1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:25.726309 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75e048e5-ab23-4a6a-9b61-1ccbab4528f1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:25.726816 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-75e048e5-ab23-4a6a-9b61-1ccbab4528f1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:25.727143 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2a8f6946-914e-487e-9b1f-3284ccb437b5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:25.727753 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2a8f6946-914e-487e-9b1f-3284ccb437b5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:25.734650 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2a8f6946-914e-487e-9b1f-3284ccb437b5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:25.735100 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2a8f6946-914e-487e-9b1f-3284ccb437b5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:25.735904 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2a8f6946-914e-487e-9b1f-3284ccb437b5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:25.736476 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2a8f6946-914e-487e-9b1f-3284ccb437b5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:25.801352 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-75e048e5-ab23-4a6a-9b61-1ccbab4528f1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:25.810289 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-75e048e5-ab23-4a6a-9b61-1ccbab4528f1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1293 microversion: 2.1 time: 0.097014 May 17 22:11:25.811056 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 162/323] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:25 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:25.822386 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2a8f6946-914e-487e-9b1f-3284ccb437b5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:25.830707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2a8f6946-914e-487e-9b1f-3284ccb437b5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1308 microversion: 2.1 time: 0.107166 May 17 22:11:25.831302 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 162/324] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:25 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:26.190998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b62e4989-2386-45d1-877a-610bde6125c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:26.191671 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b62e4989-2386-45d1-877a-610bde6125c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:26.198479 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b62e4989-2386-45d1-877a-610bde6125c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:26.198995 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b62e4989-2386-45d1-877a-610bde6125c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:26.199840 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b62e4989-2386-45d1-877a-610bde6125c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:26.200277 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b62e4989-2386-45d1-877a-610bde6125c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:26.324926 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b62e4989-2386-45d1-877a-610bde6125c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:26.332055 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b62e4989-2386-45d1-877a-610bde6125c0 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.144932 May 17 22:11:26.332613 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 163/325] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:26 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:26.476865 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7384328f-c3eb-4f78-a735-c60014ba865e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:26.483271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7384328f-c3eb-4f78-a735-c60014ba865e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:26.483712 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7384328f-c3eb-4f78-a735-c60014ba865e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:26.542901 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7384328f-c3eb-4f78-a735-c60014ba865e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Going to try to stop instance {{(pid=117593) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 22:11:26.727699 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5d7dcab7-22c8-4ac0-b767-79af38db0b17 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:26.728263 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7384328f-c3eb-4f78-a735-c60014ba865e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "POST /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/action" status: 202 len: 0 microversion: 2.1 time: 0.254328 May 17 22:11:26.728373 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5d7dcab7-22c8-4ac0-b767-79af38db0b17 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:26.728464 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 163/326] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:11:26 2022] POST /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:11:26.736255 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d7dcab7-22c8-4ac0-b767-79af38db0b17 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:26.736704 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d7dcab7-22c8-4ac0-b767-79af38db0b17 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:26.739504 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d7dcab7-22c8-4ac0-b767-79af38db0b17 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:26.739613 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-88f830d0-1bdc-4c95-9a90-e0535435392d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:26.739734 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d7dcab7-22c8-4ac0-b767-79af38db0b17 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:26.739829 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-88f830d0-1bdc-4c95-9a90-e0535435392d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:26.744557 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-88f830d0-1bdc-4c95-9a90-e0535435392d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:26.745031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-88f830d0-1bdc-4c95-9a90-e0535435392d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:26.745814 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-88f830d0-1bdc-4c95-9a90-e0535435392d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:26.746245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-88f830d0-1bdc-4c95-9a90-e0535435392d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:26.927655 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5d7dcab7-22c8-4ac0-b767-79af38db0b17 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:26.937273 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-88f830d0-1bdc-4c95-9a90-e0535435392d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:26.937658 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5d7dcab7-22c8-4ac0-b767-79af38db0b17 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.212767 May 17 22:11:26.937789 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 164/327] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:26 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:26.944393 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-88f830d0-1bdc-4c95-9a90-e0535435392d tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.210824 May 17 22:11:26.954295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-990c1034-e349-4ec7-93b7-cfcfdaaa60e8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:26.954604 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 164/328] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:26 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:26.954697 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-990c1034-e349-4ec7-93b7-cfcfdaaa60e8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:26.954791 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b6a6b654-c2f2-4c39-9562-97dc484bf607 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:26.954791 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b6a6b654-c2f2-4c39-9562-97dc484bf607 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:26.954962 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-990c1034-e349-4ec7-93b7-cfcfdaaa60e8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:26.954962 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-990c1034-e349-4ec7-93b7-cfcfdaaa60e8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:26.954962 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-990c1034-e349-4ec7-93b7-cfcfdaaa60e8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:26.955237 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-990c1034-e349-4ec7-93b7-cfcfdaaa60e8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:26.959276 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6a6b654-c2f2-4c39-9562-97dc484bf607 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:26.959761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6a6b654-c2f2-4c39-9562-97dc484bf607 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:26.960560 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6a6b654-c2f2-4c39-9562-97dc484bf607 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:26.960993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b6a6b654-c2f2-4c39-9562-97dc484bf607 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:27.044339 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b6a6b654-c2f2-4c39-9562-97dc484bf607 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:27.051557 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b6a6b654-c2f2-4c39-9562-97dc484bf607 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1293 microversion: 2.1 time: 0.104481 May 17 22:11:27.058552 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 165/329] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:26 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:27.064674 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1d82c9ce-cb9f-4a80-a33f-405810e712f8 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:27.065289 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1d82c9ce-cb9f-4a80-a33f-405810e712f8 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:27.071253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d82c9ce-cb9f-4a80-a33f-405810e712f8 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:27.071706 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d82c9ce-cb9f-4a80-a33f-405810e712f8 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:27.072993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d82c9ce-cb9f-4a80-a33f-405810e712f8 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:27.073429 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d82c9ce-cb9f-4a80-a33f-405810e712f8 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:27.330500 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1d82c9ce-cb9f-4a80-a33f-405810e712f8 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:27.337819 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1d82c9ce-cb9f-4a80-a33f-405810e712f8 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1308 microversion: 2.1 time: 0.284750 May 17 22:11:27.338445 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 166/330] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:27 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1308 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:27.350811 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-990c1034-e349-4ec7-93b7-cfcfdaaa60e8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:27.352370 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-97a074ee-5cc2-43bb-a800-3ceba90f8d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:27.352982 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-97a074ee-5cc2-43bb-a800-3ceba90f8d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:27.359368 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97a074ee-5cc2-43bb-a800-3ceba90f8d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:27.359524 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-990c1034-e349-4ec7-93b7-cfcfdaaa60e8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:27.359825 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97a074ee-5cc2-43bb-a800-3ceba90f8d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:27.360597 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97a074ee-5cc2-43bb-a800-3ceba90f8d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:27.360898 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-990c1034-e349-4ec7-93b7-cfcfdaaa60e8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:27.361036 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97a074ee-5cc2-43bb-a800-3ceba90f8d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:27.362031 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-990c1034-e349-4ec7-93b7-cfcfdaaa60e8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.422976 May 17 22:11:27.362693 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 165/331] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:26 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:27.486295 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-97a074ee-5cc2-43bb-a800-3ceba90f8d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:27.493514 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-97a074ee-5cc2-43bb-a800-3ceba90f8d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.145058 May 17 22:11:27.494073 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 167/332] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:27 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:27.953178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-40424dd7-ece7-486b-ae3f-28591b84352b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:27.954112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-40424dd7-ece7-486b-ae3f-28591b84352b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:27.960523 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-40424dd7-ece7-486b-ae3f-28591b84352b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:27.960647 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-40424dd7-ece7-486b-ae3f-28591b84352b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:27.961337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-40424dd7-ece7-486b-ae3f-28591b84352b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:27.961762 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-40424dd7-ece7-486b-ae3f-28591b84352b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:27.966430 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3aa900de-bc74-41fa-8a86-86203413d2e9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:27.967632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3aa900de-bc74-41fa-8a86-86203413d2e9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:27.979382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3aa900de-bc74-41fa-8a86-86203413d2e9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:27.979382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3aa900de-bc74-41fa-8a86-86203413d2e9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:27.979382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3aa900de-bc74-41fa-8a86-86203413d2e9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:27.979382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3aa900de-bc74-41fa-8a86-86203413d2e9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:28.159365 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3aa900de-bc74-41fa-8a86-86203413d2e9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:28.173543 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-40424dd7-ece7-486b-ae3f-28591b84352b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:28.180500 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-40424dd7-ece7-486b-ae3f-28591b84352b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.231045 May 17 22:11:28.181536 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3aa900de-bc74-41fa-8a86-86203413d2e9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.219570 May 17 22:11:28.191408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 166/333] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:27 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:28.193891 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 168/334] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:27 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:28.197432 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e8899ec8-0d02-4cbe-addf-c568a114a350 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:28.204479 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e8899ec8-0d02-4cbe-addf-c568a114a350 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:28.205164 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e8899ec8-0d02-4cbe-addf-c568a114a350 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:28.205680 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e8899ec8-0d02-4cbe-addf-c568a114a350 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:28.206585 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e8899ec8-0d02-4cbe-addf-c568a114a350 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:28.207098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e8899ec8-0d02-4cbe-addf-c568a114a350 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:28.277419 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e8899ec8-0d02-4cbe-addf-c568a114a350 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:28.285934 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e8899ec8-0d02-4cbe-addf-c568a114a350 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1293 microversion: 2.1 time: 0.093204 May 17 22:11:28.290907 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 167/335] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:28 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:28.355821 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-091bc14c-7d21-42bf-92ba-5683b570de66 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:28.356623 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-091bc14c-7d21-42bf-92ba-5683b570de66 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:28.363051 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-091bc14c-7d21-42bf-92ba-5683b570de66 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:28.363541 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-091bc14c-7d21-42bf-92ba-5683b570de66 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:28.364326 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-091bc14c-7d21-42bf-92ba-5683b570de66 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:28.364765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-091bc14c-7d21-42bf-92ba-5683b570de66 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:28.381937 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5ca91d4d-2367-4320-8824-dcf86d22b29a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:28.382657 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5ca91d4d-2367-4320-8824-dcf86d22b29a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:28.389617 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5ca91d4d-2367-4320-8824-dcf86d22b29a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:28.389914 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5ca91d4d-2367-4320-8824-dcf86d22b29a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:28.391059 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5ca91d4d-2367-4320-8824-dcf86d22b29a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:28.391530 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5ca91d4d-2367-4320-8824-dcf86d22b29a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:28.438171 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-091bc14c-7d21-42bf-92ba-5683b570de66 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:28.445640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-091bc14c-7d21-42bf-92ba-5683b570de66 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1308 microversion: 2.1 time: 0.094580 May 17 22:11:28.446219 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 169/336] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:28 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:28.509886 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a5a1971a-37d7-47c4-81d8-5478cf30e770 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:28.511826 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a5a1971a-37d7-47c4-81d8-5478cf30e770 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:28.517927 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5a1971a-37d7-47c4-81d8-5478cf30e770 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:28.518384 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5a1971a-37d7-47c4-81d8-5478cf30e770 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:28.519225 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5a1971a-37d7-47c4-81d8-5478cf30e770 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:28.519856 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5a1971a-37d7-47c4-81d8-5478cf30e770 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:28.532291 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5ca91d4d-2367-4320-8824-dcf86d22b29a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:28.540856 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5ca91d4d-2367-4320-8824-dcf86d22b29a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:28.543218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5ca91d4d-2367-4320-8824-dcf86d22b29a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:28.544529 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5ca91d4d-2367-4320-8824-dcf86d22b29a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1745 microversion: 2.20 time: 0.167658 May 17 22:11:28.545401 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 168/337] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:28 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:11:28.658944 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a5a1971a-37d7-47c4-81d8-5478cf30e770 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:28.666239 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a5a1971a-37d7-47c4-81d8-5478cf30e770 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.160301 May 17 22:11:28.666803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 170/338] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:28 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:29.198169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-edcc4ad7-cca3-4a18-afad-afb167337550 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:29.198737 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-edcc4ad7-cca3-4a18-afad-afb167337550 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:29.199867 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1fbb536c-6cdc-4473-84e5-897e472e069e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:29.200800 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1fbb536c-6cdc-4473-84e5-897e472e069e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:29.205275 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-edcc4ad7-cca3-4a18-afad-afb167337550 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:29.205725 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-edcc4ad7-cca3-4a18-afad-afb167337550 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:29.206505 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-edcc4ad7-cca3-4a18-afad-afb167337550 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:29.206936 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-edcc4ad7-cca3-4a18-afad-afb167337550 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:29.207501 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1fbb536c-6cdc-4473-84e5-897e472e069e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:29.207624 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1fbb536c-6cdc-4473-84e5-897e472e069e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:29.208349 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1fbb536c-6cdc-4473-84e5-897e472e069e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:29.208782 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1fbb536c-6cdc-4473-84e5-897e472e069e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:29.409468 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-edcc4ad7-cca3-4a18-afad-afb167337550 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:29.412701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1fbb536c-6cdc-4473-84e5-897e472e069e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:29.419080 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-edcc4ad7-cca3-4a18-afad-afb167337550 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.224818 May 17 22:11:29.419895 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 169/339] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:29 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:29.424400 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ffd990aa-d480-4e04-9276-9bc2f0978bc6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:29.425114 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ffd990aa-d480-4e04-9276-9bc2f0978bc6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:29.430409 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1fbb536c-6cdc-4473-84e5-897e472e069e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.234474 May 17 22:11:29.431008 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 171/340] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:29 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:29.435258 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ffd990aa-d480-4e04-9276-9bc2f0978bc6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:29.435258 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ffd990aa-d480-4e04-9276-9bc2f0978bc6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:29.435258 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ffd990aa-d480-4e04-9276-9bc2f0978bc6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:29.435258 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ffd990aa-d480-4e04-9276-9bc2f0978bc6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:29.464617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7089d53b-4e9e-4825-a867-a2c0ce8faa47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:29.465138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7089d53b-4e9e-4825-a867-a2c0ce8faa47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:29.471223 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7089d53b-4e9e-4825-a867-a2c0ce8faa47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:29.471774 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7089d53b-4e9e-4825-a867-a2c0ce8faa47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:29.472550 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7089d53b-4e9e-4825-a867-a2c0ce8faa47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:29.472998 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7089d53b-4e9e-4825-a867-a2c0ce8faa47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:29.504120 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ffd990aa-d480-4e04-9276-9bc2f0978bc6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:29.512554 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ffd990aa-d480-4e04-9276-9bc2f0978bc6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1293 microversion: 2.1 time: 0.091875 May 17 22:11:29.513374 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 170/341] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:29 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:29.533164 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7089d53b-4e9e-4825-a867-a2c0ce8faa47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:29.540445 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7089d53b-4e9e-4825-a867-a2c0ce8faa47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1308 microversion: 2.1 time: 0.080403 May 17 22:11:29.540995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 172/342] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:29 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1308 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:29.565921 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0cd714d9-d357-4606-a07d-46b4d2412f68 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:29.566520 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0cd714d9-d357-4606-a07d-46b4d2412f68 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:29.572344 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0cd714d9-d357-4606-a07d-46b4d2412f68 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:29.573319 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0cd714d9-d357-4606-a07d-46b4d2412f68 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:29.574073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0cd714d9-d357-4606-a07d-46b4d2412f68 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:29.574500 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0cd714d9-d357-4606-a07d-46b4d2412f68 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:29.684719 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3e81fb6f-ef90-48ab-a696-7556f944e6ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:29.685338 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3e81fb6f-ef90-48ab-a696-7556f944e6ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:29.691215 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e81fb6f-ef90-48ab-a696-7556f944e6ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:29.691662 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e81fb6f-ef90-48ab-a696-7556f944e6ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:29.692428 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e81fb6f-ef90-48ab-a696-7556f944e6ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:29.692867 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e81fb6f-ef90-48ab-a696-7556f944e6ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:29.704170 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0cd714d9-d357-4606-a07d-46b4d2412f68 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:29.711781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0cd714d9-d357-4606-a07d-46b4d2412f68 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:29.713345 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0cd714d9-d357-4606-a07d-46b4d2412f68 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:29.714535 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0cd714d9-d357-4606-a07d-46b4d2412f68 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1745 microversion: 2.20 time: 0.152507 May 17 22:11:29.716535 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 171/343] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:29 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:29.821426 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3e81fb6f-ef90-48ab-a696-7556f944e6ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:29.829808 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3e81fb6f-ef90-48ab-a696-7556f944e6ca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.150347 May 17 22:11:29.830390 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 173/344] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:29 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:30.436170 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a1bcebd5-f418-4253-ae1e-25922326cac8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:30.437325 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a1bcebd5-f418-4253-ae1e-25922326cac8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:30.443181 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1bcebd5-f418-4253-ae1e-25922326cac8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:30.443635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1bcebd5-f418-4253-ae1e-25922326cac8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:30.444710 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1bcebd5-f418-4253-ae1e-25922326cac8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:30.445142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1bcebd5-f418-4253-ae1e-25922326cac8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:30.450003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c8c44239-3b0e-4614-b844-3f308957707c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:30.450608 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c8c44239-3b0e-4614-b844-3f308957707c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:30.456304 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8c44239-3b0e-4614-b844-3f308957707c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:30.456749 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8c44239-3b0e-4614-b844-3f308957707c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:30.457506 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8c44239-3b0e-4614-b844-3f308957707c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:30.457935 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c8c44239-3b0e-4614-b844-3f308957707c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:30.636974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a1bcebd5-f418-4253-ae1e-25922326cac8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:30.640119 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c8c44239-3b0e-4614-b844-3f308957707c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:30.644543 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a1bcebd5-f418-4253-ae1e-25922326cac8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.213031 May 17 22:11:30.645116 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 172/345] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:30 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:30.649520 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-188097ce-377a-48de-85d2-9f2ffd085690 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:30.650120 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-188097ce-377a-48de-85d2-9f2ffd085690 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:30.651370 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c8c44239-3b0e-4614-b844-3f308957707c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.205661 May 17 22:11:30.652004 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 174/346] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:30 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:30.656572 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-188097ce-377a-48de-85d2-9f2ffd085690 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:30.656730 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-36b22a01-883a-4bcc-980b-20d13497c9ae tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:30.657024 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-188097ce-377a-48de-85d2-9f2ffd085690 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:30.657276 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-36b22a01-883a-4bcc-980b-20d13497c9ae tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:30.657791 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-188097ce-377a-48de-85d2-9f2ffd085690 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:30.658225 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-188097ce-377a-48de-85d2-9f2ffd085690 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:30.663143 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-36b22a01-883a-4bcc-980b-20d13497c9ae tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:30.663600 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-36b22a01-883a-4bcc-980b-20d13497c9ae tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:30.664374 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-36b22a01-883a-4bcc-980b-20d13497c9ae tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:30.664812 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-36b22a01-883a-4bcc-980b-20d13497c9ae tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:30.739792 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-36b22a01-883a-4bcc-980b-20d13497c9ae tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:30.740300 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-188097ce-377a-48de-85d2-9f2ffd085690 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:30.748398 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-36b22a01-883a-4bcc-980b-20d13497c9ae tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1308 microversion: 2.1 time: 0.095190 May 17 22:11:30.748570 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-188097ce-377a-48de-85d2-9f2ffd085690 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1293 microversion: 2.1 time: 0.102284 May 17 22:11:30.748967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 175/347] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:30 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:30.750606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 173/348] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:30 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:30.753919 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9ff34bfc-043d-494a-a876-9f7e2549d13e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:30.754512 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9ff34bfc-043d-494a-a876-9f7e2549d13e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:30.760913 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9ff34bfc-043d-494a-a876-9f7e2549d13e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:30.761355 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9ff34bfc-043d-494a-a876-9f7e2549d13e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:30.762111 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9ff34bfc-043d-494a-a876-9f7e2549d13e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:30.762543 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9ff34bfc-043d-494a-a876-9f7e2549d13e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:30.845663 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1819aec6-2127-439d-875f-2519df4a9c8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:30.849547 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1819aec6-2127-439d-875f-2519df4a9c8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:30.852275 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1819aec6-2127-439d-875f-2519df4a9c8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:30.852730 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1819aec6-2127-439d-875f-2519df4a9c8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:30.853503 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1819aec6-2127-439d-875f-2519df4a9c8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:30.854481 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1819aec6-2127-439d-875f-2519df4a9c8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:30.892845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9ff34bfc-043d-494a-a876-9f7e2549d13e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:30.900976 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9ff34bfc-043d-494a-a876-9f7e2549d13e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:30.902556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9ff34bfc-043d-494a-a876-9f7e2549d13e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:30.903696 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9ff34bfc-043d-494a-a876-9f7e2549d13e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1745 microversion: 2.20 time: 0.153523 May 17 22:11:30.904263 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 176/349] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:30 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:30.991425 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1819aec6-2127-439d-875f-2519df4a9c8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:30.999210 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1819aec6-2127-439d-875f-2519df4a9c8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.157319 May 17 22:11:30.999774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 174/350] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:30 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:31.662209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fdc70250-91bb-458c-b2a9-23b532e535dc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:31.662828 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fdc70250-91bb-458c-b2a9-23b532e535dc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:31.670283 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c970b0d0-cda6-4e2e-90dc-006932df256f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:31.670778 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fdc70250-91bb-458c-b2a9-23b532e535dc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:31.670988 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fdc70250-91bb-458c-b2a9-23b532e535dc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:31.671162 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c970b0d0-cda6-4e2e-90dc-006932df256f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:31.671805 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fdc70250-91bb-458c-b2a9-23b532e535dc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:31.672307 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fdc70250-91bb-458c-b2a9-23b532e535dc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:31.678605 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c970b0d0-cda6-4e2e-90dc-006932df256f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:31.679076 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c970b0d0-cda6-4e2e-90dc-006932df256f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:31.679868 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c970b0d0-cda6-4e2e-90dc-006932df256f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:31.680307 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c970b0d0-cda6-4e2e-90dc-006932df256f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:31.863125 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fdc70250-91bb-458c-b2a9-23b532e535dc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:31.869611 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c970b0d0-cda6-4e2e-90dc-006932df256f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:31.872134 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fdc70250-91bb-458c-b2a9-23b532e535dc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1318 microversion: 2.1 time: 0.214128 May 17 22:11:31.872661 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 177/351] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:31 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:31.877214 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7a9ec93f-bbfb-442b-8c7d-ce88b00b133f tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:31.877806 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7a9ec93f-bbfb-442b-8c7d-ce88b00b133f tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:31.878909 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c970b0d0-cda6-4e2e-90dc-006932df256f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.214391 May 17 22:11:31.883496 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7a9ec93f-bbfb-442b-8c7d-ce88b00b133f tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:31.883739 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 175/352] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:31 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:31.883942 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7a9ec93f-bbfb-442b-8c7d-ce88b00b133f tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:31.884730 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7a9ec93f-bbfb-442b-8c7d-ce88b00b133f tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:31.885679 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7a9ec93f-bbfb-442b-8c7d-ce88b00b133f tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:31.889342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-72dbecba-ab6f-4f53-b550-624b905d072a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:31.891385 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-72dbecba-ab6f-4f53-b550-624b905d072a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:31.898538 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-72dbecba-ab6f-4f53-b550-624b905d072a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:31.898987 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-72dbecba-ab6f-4f53-b550-624b905d072a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:31.902872 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-72dbecba-ab6f-4f53-b550-624b905d072a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:31.902872 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-72dbecba-ab6f-4f53-b550-624b905d072a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:31.953230 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7a9ec93f-bbfb-442b-8c7d-ce88b00b133f tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:31.961230 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7a9ec93f-bbfb-442b-8c7d-ce88b00b133f tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1308 microversion: 2.1 time: 0.087469 May 17 22:11:31.971736 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 178/353] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:31 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:31.971736 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2acfac57-92d0-4bf6-91af-7fa4c5e0733d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:31.971736 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2acfac57-92d0-4bf6-91af-7fa4c5e0733d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:31.975647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2acfac57-92d0-4bf6-91af-7fa4c5e0733d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:31.975909 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2acfac57-92d0-4bf6-91af-7fa4c5e0733d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:31.976687 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2acfac57-92d0-4bf6-91af-7fa4c5e0733d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:31.977118 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2acfac57-92d0-4bf6-91af-7fa4c5e0733d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:31.983351 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-72dbecba-ab6f-4f53-b550-624b905d072a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:31.990674 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-72dbecba-ab6f-4f53-b550-624b905d072a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1293 microversion: 2.1 time: 0.105746 May 17 22:11:31.995162 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 176/354] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:31 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:32.014962 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-23c86887-be54-4edf-a0c5-83edb57928b2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:32.015706 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-23c86887-be54-4edf-a0c5-83edb57928b2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:32.026949 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-23c86887-be54-4edf-a0c5-83edb57928b2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:32.026949 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-23c86887-be54-4edf-a0c5-83edb57928b2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:32.026949 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-23c86887-be54-4edf-a0c5-83edb57928b2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:32.026949 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-23c86887-be54-4edf-a0c5-83edb57928b2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:32.225928 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2acfac57-92d0-4bf6-91af-7fa4c5e0733d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:32.235724 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2acfac57-92d0-4bf6-91af-7fa4c5e0733d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:32.237218 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2acfac57-92d0-4bf6-91af-7fa4c5e0733d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:32.238377 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2acfac57-92d0-4bf6-91af-7fa4c5e0733d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1745 microversion: 2.20 time: 0.275676 May 17 22:11:32.242900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 179/355] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:31 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1745 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:32.273670 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-23c86887-be54-4edf-a0c5-83edb57928b2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:32.282215 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-23c86887-be54-4edf-a0c5-83edb57928b2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.271322 May 17 22:11:32.283970 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 177/356] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:32 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:32.386811 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-16c8cbfc-a20a-4d8b-8ba8-c6fcbb403eec req-45ec9bb9-4b72-4bef-abdc-e3c6d5b29e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c568a7b-6b45-45c4-b60a-3514d7c43e6e", "name": "network-vif-plugged", "status": "completed", "tag": "501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:32.395300 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-16c8cbfc-a20a-4d8b-8ba8-c6fcbb403eec req-45ec9bb9-4b72-4bef-abdc-e3c6d5b29e81 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:32.395663 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-16c8cbfc-a20a-4d8b-8ba8-c6fcbb403eec req-45ec9bb9-4b72-4bef-abdc-e3c6d5b29e81 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:32.407306 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-16c8cbfc-a20a-4d8b-8ba8-c6fcbb403eec req-45ec9bb9-4b72-4bef-abdc-e3c6d5b29e81 service nova] Creating event network-vif-plugged:501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e for instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e on hv-cinder-83998 May 17 22:11:32.412318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-16c8cbfc-a20a-4d8b-8ba8-c6fcbb403eec req-45ec9bb9-4b72-4bef-abdc-e3c6d5b29e81 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029799 May 17 22:11:32.413153 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 180/357] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:11:32.889567 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-37fa6bf6-a559-41d7-9666-497ae94e4cea tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:32.890765 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-37fa6bf6-a559-41d7-9666-497ae94e4cea tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:32.898495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a0042743-e447-4862-979b-882e3b9837db tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:32.899372 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a0042743-e447-4862-979b-882e3b9837db tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:32.901132 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-37fa6bf6-a559-41d7-9666-497ae94e4cea tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:32.901588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-37fa6bf6-a559-41d7-9666-497ae94e4cea tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:32.902373 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-37fa6bf6-a559-41d7-9666-497ae94e4cea tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:32.902804 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-37fa6bf6-a559-41d7-9666-497ae94e4cea tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:32.906835 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0042743-e447-4862-979b-882e3b9837db tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:32.907415 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0042743-e447-4862-979b-882e3b9837db tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:32.908473 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0042743-e447-4862-979b-882e3b9837db tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:32.909116 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a0042743-e447-4862-979b-882e3b9837db tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:33.178258 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a0042743-e447-4862-979b-882e3b9837db tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:33.187758 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-37fa6bf6-a559-41d7-9666-497ae94e4cea tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:33.190655 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a0042743-e447-4862-979b-882e3b9837db tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.297445 May 17 22:11:33.191576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 181/358] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:32 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:33.195392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-37fa6bf6-a559-41d7-9666-497ae94e4cea tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1506 microversion: 2.1 time: 0.311090 May 17 22:11:33.195951 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 178/359] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:32 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:33.196501 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c0f346dd-f1a2-4d57-94be-2d5706fa5698 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:33.197270 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c0f346dd-f1a2-4d57-94be-2d5706fa5698 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:33.204023 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c0f346dd-f1a2-4d57-94be-2d5706fa5698 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:33.204509 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c0f346dd-f1a2-4d57-94be-2d5706fa5698 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:33.206557 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c0f346dd-f1a2-4d57-94be-2d5706fa5698 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:33.207188 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c0f346dd-f1a2-4d57-94be-2d5706fa5698 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:33.209301 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e60372f1-80b9-44b3-a0ed-71d41f2bcc07 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:33.210168 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e60372f1-80b9-44b3-a0ed-71d41f2bcc07 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:33.217649 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e60372f1-80b9-44b3-a0ed-71d41f2bcc07 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:33.218399 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e60372f1-80b9-44b3-a0ed-71d41f2bcc07 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:33.219551 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e60372f1-80b9-44b3-a0ed-71d41f2bcc07 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:33.220191 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e60372f1-80b9-44b3-a0ed-71d41f2bcc07 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:33.277372 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c0f346dd-f1a2-4d57-94be-2d5706fa5698 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:33.287124 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c0f346dd-f1a2-4d57-94be-2d5706fa5698 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1316 microversion: 2.1 time: 0.094356 May 17 22:11:33.296867 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 182/360] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:33 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1316 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:33.296867 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8bb278dd-51ec-4f67-afb6-faf55b74b4f8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:33.296867 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8bb278dd-51ec-4f67-afb6-faf55b74b4f8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:33.300744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8bb278dd-51ec-4f67-afb6-faf55b74b4f8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:33.301196 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8bb278dd-51ec-4f67-afb6-faf55b74b4f8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:33.301975 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8bb278dd-51ec-4f67-afb6-faf55b74b4f8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:33.302403 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8bb278dd-51ec-4f67-afb6-faf55b74b4f8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:33.304021 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e60372f1-80b9-44b3-a0ed-71d41f2bcc07 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:33.317230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e60372f1-80b9-44b3-a0ed-71d41f2bcc07 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1311 microversion: 2.1 time: 0.115234 May 17 22:11:33.317230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 179/361] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:33 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:33.317824 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-43ca6ec2-27b1-4e06-bc5f-a42d811fa208 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:33.318449 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-43ca6ec2-27b1-4e06-bc5f-a42d811fa208 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:33.328996 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-43ca6ec2-27b1-4e06-bc5f-a42d811fa208 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:33.329571 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-43ca6ec2-27b1-4e06-bc5f-a42d811fa208 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:33.330895 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-43ca6ec2-27b1-4e06-bc5f-a42d811fa208 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:33.331373 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-43ca6ec2-27b1-4e06-bc5f-a42d811fa208 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:33.520425 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8bb278dd-51ec-4f67-afb6-faf55b74b4f8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:33.527429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-43ca6ec2-27b1-4e06-bc5f-a42d811fa208 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:33.528564 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8bb278dd-51ec-4f67-afb6-faf55b74b4f8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:33.530067 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8bb278dd-51ec-4f67-afb6-faf55b74b4f8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:33.531244 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8bb278dd-51ec-4f67-afb6-faf55b74b4f8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1745 microversion: 2.20 time: 0.241974 May 17 22:11:33.531801 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 183/362] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:33 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1745 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:33.535006 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-43ca6ec2-27b1-4e06-bc5f-a42d811fa208 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.220666 May 17 22:11:33.535597 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 180/363] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:33 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:34.208757 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-53a28cc5-c5e4-4630-b370-e047f6b1cf63 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:34.209430 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-53a28cc5-c5e4-4630-b370-e047f6b1cf63 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:34.215983 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53a28cc5-c5e4-4630-b370-e047f6b1cf63 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:34.216431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53a28cc5-c5e4-4630-b370-e047f6b1cf63 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:34.217206 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53a28cc5-c5e4-4630-b370-e047f6b1cf63 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:34.217642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53a28cc5-c5e4-4630-b370-e047f6b1cf63 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:34.305020 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-31b20878-9498-4d9a-b3fa-a25aeae84652 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:34.305633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-31b20878-9498-4d9a-b3fa-a25aeae84652 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:34.312784 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-31b20878-9498-4d9a-b3fa-a25aeae84652 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:34.313234 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-31b20878-9498-4d9a-b3fa-a25aeae84652 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:34.314016 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-31b20878-9498-4d9a-b3fa-a25aeae84652 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:34.314453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-31b20878-9498-4d9a-b3fa-a25aeae84652 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:34.376576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-53a28cc5-c5e4-4630-b370-e047f6b1cf63 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:34.376576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-53a28cc5-c5e4-4630-b370-e047f6b1cf63 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.165194 May 17 22:11:34.376576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 184/364] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:34 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:34.376576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-025ad493-fb46-4fc0-9d6d-1cd682fbb1e2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:34.377136 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-025ad493-fb46-4fc0-9d6d-1cd682fbb1e2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:34.382762 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-31b20878-9498-4d9a-b3fa-a25aeae84652 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:34.388034 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-025ad493-fb46-4fc0-9d6d-1cd682fbb1e2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:34.388586 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-025ad493-fb46-4fc0-9d6d-1cd682fbb1e2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:34.389690 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-025ad493-fb46-4fc0-9d6d-1cd682fbb1e2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:34.390121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-025ad493-fb46-4fc0-9d6d-1cd682fbb1e2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:34.390934 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-31b20878-9498-4d9a-b3fa-a25aeae84652 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1316 microversion: 2.1 time: 0.090057 May 17 22:11:34.391527 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 181/365] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:34 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1316 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:34.460251 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-025ad493-fb46-4fc0-9d6d-1cd682fbb1e2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:34.468437 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-025ad493-fb46-4fc0-9d6d-1cd682fbb1e2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1311 microversion: 2.1 time: 0.096122 May 17 22:11:34.469003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 185/366] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:34 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:34.555768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ca7dbd7b-6688-4618-bb84-032f8d931d54 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:34.556543 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-260d951e-b50c-4c16-aa98-34e3721c8a41 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:34.558062 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-260d951e-b50c-4c16-aa98-34e3721c8a41 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:34.558509 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ca7dbd7b-6688-4618-bb84-032f8d931d54 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:34.569835 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-260d951e-b50c-4c16-aa98-34e3721c8a41 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:34.571772 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ca7dbd7b-6688-4618-bb84-032f8d931d54 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:34.572521 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-260d951e-b50c-4c16-aa98-34e3721c8a41 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:34.573871 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ca7dbd7b-6688-4618-bb84-032f8d931d54 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:34.574479 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-260d951e-b50c-4c16-aa98-34e3721c8a41 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:34.576522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-260d951e-b50c-4c16-aa98-34e3721c8a41 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:34.581061 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ca7dbd7b-6688-4618-bb84-032f8d931d54 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:34.581786 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ca7dbd7b-6688-4618-bb84-032f8d931d54 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:34.824140 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ca7dbd7b-6688-4618-bb84-032f8d931d54 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:34.833837 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-260d951e-b50c-4c16-aa98-34e3721c8a41 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:34.839244 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ca7dbd7b-6688-4618-bb84-032f8d931d54 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.290680 May 17 22:11:34.839833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 186/367] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:34 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:34.842422 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-260d951e-b50c-4c16-aa98-34e3721c8a41 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:34.845043 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-260d951e-b50c-4c16-aa98-34e3721c8a41 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:34.846455 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-260d951e-b50c-4c16-aa98-34e3721c8a41 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1745 microversion: 2.20 time: 0.299597 May 17 22:11:34.847180 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 182/368] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:34 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1745 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:35.389645 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d0b43cb7-fae5-4491-9862-0904505c32c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:35.390981 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d0b43cb7-fae5-4491-9862-0904505c32c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:35.399352 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0b43cb7-fae5-4491-9862-0904505c32c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:35.399819 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0b43cb7-fae5-4491-9862-0904505c32c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:35.400953 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0b43cb7-fae5-4491-9862-0904505c32c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:35.405857 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d0b43cb7-fae5-4491-9862-0904505c32c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:35.410401 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b8400251-c1ed-4108-9a87-dd323222546e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:35.410901 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b8400251-c1ed-4108-9a87-dd323222546e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:35.427778 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8400251-c1ed-4108-9a87-dd323222546e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:35.428479 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8400251-c1ed-4108-9a87-dd323222546e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:35.429661 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8400251-c1ed-4108-9a87-dd323222546e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:35.430295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8400251-c1ed-4108-9a87-dd323222546e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:35.847951 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d0b43cb7-fae5-4491-9862-0904505c32c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:35.858179 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d0b43cb7-fae5-4491-9862-0904505c32c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.473859 May 17 22:11:35.869490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 187/369] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:35 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:35.873611 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b8400251-c1ed-4108-9a87-dd323222546e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:35.875474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9573243d-f3b4-4bee-9dfd-fb24b9b8419c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:35.877292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9573243d-f3b4-4bee-9dfd-fb24b9b8419c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:35.884478 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9573243d-f3b4-4bee-9dfd-fb24b9b8419c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:35.886405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9573243d-f3b4-4bee-9dfd-fb24b9b8419c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:35.887498 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9573243d-f3b4-4bee-9dfd-fb24b9b8419c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:35.888171 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9573243d-f3b4-4bee-9dfd-fb24b9b8419c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:35.896410 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b8400251-c1ed-4108-9a87-dd323222546e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.492316 May 17 22:11:35.899192 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 183/370] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:35 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:35.905783 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-10ee12d7-26e2-4225-b51d-4df63e251bba tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:35.906400 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-10ee12d7-26e2-4225-b51d-4df63e251bba tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:35.922936 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10ee12d7-26e2-4225-b51d-4df63e251bba tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:35.923451 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10ee12d7-26e2-4225-b51d-4df63e251bba tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:35.924672 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10ee12d7-26e2-4225-b51d-4df63e251bba tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:35.925182 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10ee12d7-26e2-4225-b51d-4df63e251bba tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:36.294221 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-10ee12d7-26e2-4225-b51d-4df63e251bba tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:36.314933 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-10ee12d7-26e2-4225-b51d-4df63e251bba tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.414345 May 17 22:11:36.321740 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 184/371] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:35 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:36.352572 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dbd1f5ad-6a63-425b-9940-50ca6dc2c875 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:36.353527 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dbd1f5ad-6a63-425b-9940-50ca6dc2c875 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:36.370841 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbd1f5ad-6a63-425b-9940-50ca6dc2c875 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:36.374417 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbd1f5ad-6a63-425b-9940-50ca6dc2c875 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:36.376059 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbd1f5ad-6a63-425b-9940-50ca6dc2c875 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:36.378554 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbd1f5ad-6a63-425b-9940-50ca6dc2c875 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:36.458383 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9573243d-f3b4-4bee-9dfd-fb24b9b8419c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:36.471155 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9573243d-f3b4-4bee-9dfd-fb24b9b8419c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.599484 May 17 22:11:36.471741 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 188/372] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:35 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:36.708562 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dbd1f5ad-6a63-425b-9940-50ca6dc2c875 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:36.721598 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dbd1f5ad-6a63-425b-9940-50ca6dc2c875 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:36.723380 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dbd1f5ad-6a63-425b-9940-50ca6dc2c875 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:36.724810 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dbd1f5ad-6a63-425b-9940-50ca6dc2c875 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.397572 May 17 22:11:36.725706 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 185/373] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:36 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:36.876676 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0f46614a-8b40-4053-9ccf-7921ca23a036 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:36.881302 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0f46614a-8b40-4053-9ccf-7921ca23a036 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:36.892848 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0f46614a-8b40-4053-9ccf-7921ca23a036 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:36.907591 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0f46614a-8b40-4053-9ccf-7921ca23a036 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:36.908673 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0f46614a-8b40-4053-9ccf-7921ca23a036 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:36.910226 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0f46614a-8b40-4053-9ccf-7921ca23a036 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:36.917121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b93ca18b-e6b9-402b-933e-8f9a0277f66d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:36.918151 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b93ca18b-e6b9-402b-933e-8f9a0277f66d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:36.937557 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b93ca18b-e6b9-402b-933e-8f9a0277f66d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:36.938352 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b93ca18b-e6b9-402b-933e-8f9a0277f66d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:36.939521 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b93ca18b-e6b9-402b-933e-8f9a0277f66d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:36.946621 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b93ca18b-e6b9-402b-933e-8f9a0277f66d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:37.270284 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0f46614a-8b40-4053-9ccf-7921ca23a036 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:37.282035 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0f46614a-8b40-4053-9ccf-7921ca23a036 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.409268 May 17 22:11:37.291487 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 189/374] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:36 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:37.346256 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d66d3ca1-086e-4c99-8794-ca6e3b760f33 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:37.347201 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d66d3ca1-086e-4c99-8794-ca6e3b760f33 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:37.362055 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d66d3ca1-086e-4c99-8794-ca6e3b760f33 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:37.367915 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d66d3ca1-086e-4c99-8794-ca6e3b760f33 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:37.369173 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d66d3ca1-086e-4c99-8794-ca6e3b760f33 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:37.374581 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d66d3ca1-086e-4c99-8794-ca6e3b760f33 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:37.537504 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b93ca18b-e6b9-402b-933e-8f9a0277f66d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:37.553824 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b93ca18b-e6b9-402b-933e-8f9a0277f66d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.641673 May 17 22:11:37.564425 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 186/375] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:36 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:37.569825 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5e87baa6-8c83-4b43-b317-78fe1278837a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:37.570486 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5e87baa6-8c83-4b43-b317-78fe1278837a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:37.578114 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e87baa6-8c83-4b43-b317-78fe1278837a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:37.578905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e87baa6-8c83-4b43-b317-78fe1278837a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:37.579950 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e87baa6-8c83-4b43-b317-78fe1278837a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:37.580605 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e87baa6-8c83-4b43-b317-78fe1278837a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:37.653942 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d66d3ca1-086e-4c99-8794-ca6e3b760f33 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:37.662794 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d66d3ca1-086e-4c99-8794-ca6e3b760f33 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.328140 May 17 22:11:37.675709 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 190/376] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:37 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:37.740763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-12d02d86-b022-4550-b1b9-9a88debc283d req-fddef6ac-5e83-466a-93ce-167085dd704c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c468659-e42a-4284-9a0c-39aa262bd9a5", "tag": "6b82dab7-02cb-4cc1-a078-91095811826f"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:37.752313 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-12d02d86-b022-4550-b1b9-9a88debc283d req-fddef6ac-5e83-466a-93ce-167085dd704c service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:37.753051 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-12d02d86-b022-4550-b1b9-9a88debc283d req-fddef6ac-5e83-466a-93ce-167085dd704c service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:37.790399 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-12d02d86-b022-4550-b1b9-9a88debc283d req-fddef6ac-5e83-466a-93ce-167085dd704c service nova] Creating event network-changed:6b82dab7-02cb-4cc1-a078-91095811826f for instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 on hv-cinder-83998 May 17 22:11:37.801485 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-12d02d86-b022-4550-b1b9-9a88debc283d req-fddef6ac-5e83-466a-93ce-167085dd704c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064853 May 17 22:11:37.802308 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 191/377] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:11:37.807630 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4ac94363-f0d9-4658-8085-eddddc69c32d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:37.830802 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4ac94363-f0d9-4658-8085-eddddc69c32d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:37.838162 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ac94363-f0d9-4658-8085-eddddc69c32d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:37.839900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ac94363-f0d9-4658-8085-eddddc69c32d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:37.841136 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ac94363-f0d9-4658-8085-eddddc69c32d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:37.841973 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ac94363-f0d9-4658-8085-eddddc69c32d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:38.016678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5e87baa6-8c83-4b43-b317-78fe1278837a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:38.016678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5e87baa6-8c83-4b43-b317-78fe1278837a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.431173 May 17 22:11:38.016678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 187/378] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:37 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:38.045786 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-451620c0-df5e-44b4-b43a-4ba347ef483c req-7707ad9a-c774-4892-a3aa-1507d345d029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429a5e1d-02ff-43b5-a293-584d721f62ca", "tag": "b2ca1063-f162-4839-8103-868d1a01da49"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:38.063739 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-451620c0-df5e-44b4-b43a-4ba347ef483c req-7707ad9a-c774-4892-a3aa-1507d345d029 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:38.064525 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-451620c0-df5e-44b4-b43a-4ba347ef483c req-7707ad9a-c774-4892-a3aa-1507d345d029 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:38.083471 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-451620c0-df5e-44b4-b43a-4ba347ef483c req-7707ad9a-c774-4892-a3aa-1507d345d029 service nova] Creating event network-changed:b2ca1063-f162-4839-8103-868d1a01da49 for instance 429a5e1d-02ff-43b5-a293-584d721f62ca on hv-cinder-83998 May 17 22:11:38.093133 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-451620c0-df5e-44b4-b43a-4ba347ef483c req-7707ad9a-c774-4892-a3aa-1507d345d029 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052696 May 17 22:11:38.094356 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 188/379] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:11:38.138738 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4ac94363-f0d9-4658-8085-eddddc69c32d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:38.147549 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4ac94363-f0d9-4658-8085-eddddc69c32d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:38.154691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4ac94363-f0d9-4658-8085-eddddc69c32d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:38.155933 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4ac94363-f0d9-4658-8085-eddddc69c32d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.352340 May 17 22:11:38.156502 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 192/380] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:37 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:38.302327 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-45af0311-d13f-4433-acf3-5773be4282c3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:38.303063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-45af0311-d13f-4433-acf3-5773be4282c3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:38.310432 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45af0311-d13f-4433-acf3-5773be4282c3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:38.310998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45af0311-d13f-4433-acf3-5773be4282c3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:38.311811 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45af0311-d13f-4433-acf3-5773be4282c3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:38.312243 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-45af0311-d13f-4433-acf3-5773be4282c3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:38.447229 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-45af0311-d13f-4433-acf3-5773be4282c3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:38.455084 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-45af0311-d13f-4433-acf3-5773be4282c3 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.156943 May 17 22:11:38.455677 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 189/381] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:38 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:38.571906 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fa7a1d37-8e84-4e29-ab3a-a5893edefcba tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:38.572439 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fa7a1d37-8e84-4e29-ab3a-a5893edefcba tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:38.578918 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fa7a1d37-8e84-4e29-ab3a-a5893edefcba tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:38.579413 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fa7a1d37-8e84-4e29-ab3a-a5893edefcba tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:38.580187 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fa7a1d37-8e84-4e29-ab3a-a5893edefcba tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:38.580624 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fa7a1d37-8e84-4e29-ab3a-a5893edefcba tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:38.680675 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8484a84f-eabb-4ea3-9f56-18086d3f7191 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:38.681278 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8484a84f-eabb-4ea3-9f56-18086d3f7191 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:38.687528 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8484a84f-eabb-4ea3-9f56-18086d3f7191 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:38.687973 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8484a84f-eabb-4ea3-9f56-18086d3f7191 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:38.688778 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8484a84f-eabb-4ea3-9f56-18086d3f7191 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:38.689209 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8484a84f-eabb-4ea3-9f56-18086d3f7191 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:38.703971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fa7a1d37-8e84-4e29-ab3a-a5893edefcba tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:38.711388 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fa7a1d37-8e84-4e29-ab3a-a5893edefcba tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.143339 May 17 22:11:38.712039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 193/382] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:38 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:38.814295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8484a84f-eabb-4ea3-9f56-18086d3f7191 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:38.821582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8484a84f-eabb-4ea3-9f56-18086d3f7191 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.144842 May 17 22:11:38.822213 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 190/383] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:38 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:39.026292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-db3baba8-12b4-4484-b046-2d4dc967f43f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:39.027014 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-db3baba8-12b4-4484-b046-2d4dc967f43f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:39.045678 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db3baba8-12b4-4484-b046-2d4dc967f43f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:39.046486 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db3baba8-12b4-4484-b046-2d4dc967f43f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:39.047821 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db3baba8-12b4-4484-b046-2d4dc967f43f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:39.048359 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-db3baba8-12b4-4484-b046-2d4dc967f43f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:39.174026 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a4462219-600f-4732-88c2-30b84922c3ac tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:39.175486 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a4462219-600f-4732-88c2-30b84922c3ac tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:39.190227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a4462219-600f-4732-88c2-30b84922c3ac tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:39.190746 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a4462219-600f-4732-88c2-30b84922c3ac tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:39.191719 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a4462219-600f-4732-88c2-30b84922c3ac tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:39.193804 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a4462219-600f-4732-88c2-30b84922c3ac tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:39.244246 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-db3baba8-12b4-4484-b046-2d4dc967f43f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:39.254607 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-db3baba8-12b4-4484-b046-2d4dc967f43f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.232320 May 17 22:11:39.265388 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 194/384] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:39 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:39.362427 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a4462219-600f-4732-88c2-30b84922c3ac tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:39.370784 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a4462219-600f-4732-88c2-30b84922c3ac tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:39.376666 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a4462219-600f-4732-88c2-30b84922c3ac tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:39.378143 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a4462219-600f-4732-88c2-30b84922c3ac tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.208050 May 17 22:11:39.379092 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 191/385] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:39 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:11:39.473016 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4b56c5bc-9850-4281-a4af-3c970e0736aa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:39.474066 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4b56c5bc-9850-4281-a4af-3c970e0736aa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:39.480391 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4b56c5bc-9850-4281-a4af-3c970e0736aa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:39.481991 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4b56c5bc-9850-4281-a4af-3c970e0736aa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:39.483050 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4b56c5bc-9850-4281-a4af-3c970e0736aa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:39.483626 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4b56c5bc-9850-4281-a4af-3c970e0736aa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:39.641642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4b56c5bc-9850-4281-a4af-3c970e0736aa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:39.650060 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4b56c5bc-9850-4281-a4af-3c970e0736aa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.181392 May 17 22:11:39.650697 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 195/386] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:39 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:39.729081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8d0d15a7-4461-411c-a1ff-344fece2000c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:39.729607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8d0d15a7-4461-411c-a1ff-344fece2000c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:39.738341 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d0d15a7-4461-411c-a1ff-344fece2000c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:39.739670 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d0d15a7-4461-411c-a1ff-344fece2000c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:39.740535 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d0d15a7-4461-411c-a1ff-344fece2000c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:39.740976 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d0d15a7-4461-411c-a1ff-344fece2000c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:39.837617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-340f5487-271c-4168-936e-1276ffa8400c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:39.838919 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-340f5487-271c-4168-936e-1276ffa8400c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:39.847090 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-340f5487-271c-4168-936e-1276ffa8400c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:39.848016 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-340f5487-271c-4168-936e-1276ffa8400c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:39.855307 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-340f5487-271c-4168-936e-1276ffa8400c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:39.856243 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-340f5487-271c-4168-936e-1276ffa8400c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:39.984368 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8d0d15a7-4461-411c-a1ff-344fece2000c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:39.999826 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8d0d15a7-4461-411c-a1ff-344fece2000c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.274054 May 17 22:11:40.012341 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 192/387] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:39 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:40.073758 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-340f5487-271c-4168-936e-1276ffa8400c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:40.078712 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-340f5487-271c-4168-936e-1276ffa8400c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.244837 May 17 22:11:40.098932 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 196/388] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:39 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:40.272451 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-42c51dbc-94c3-4732-8e89-90094f46c1dc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:40.273024 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-42c51dbc-94c3-4732-8e89-90094f46c1dc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:40.280882 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42c51dbc-94c3-4732-8e89-90094f46c1dc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:40.281328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42c51dbc-94c3-4732-8e89-90094f46c1dc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:40.284223 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42c51dbc-94c3-4732-8e89-90094f46c1dc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:40.284643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42c51dbc-94c3-4732-8e89-90094f46c1dc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:40.398092 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c08b757e-7862-4df3-97b8-ea5f3ee7fdc8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:40.398791 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c08b757e-7862-4df3-97b8-ea5f3ee7fdc8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:40.405775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c08b757e-7862-4df3-97b8-ea5f3ee7fdc8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:40.406295 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c08b757e-7862-4df3-97b8-ea5f3ee7fdc8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:40.407345 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c08b757e-7862-4df3-97b8-ea5f3ee7fdc8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:40.407786 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c08b757e-7862-4df3-97b8-ea5f3ee7fdc8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:40.488489 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-42c51dbc-94c3-4732-8e89-90094f46c1dc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:40.498106 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-42c51dbc-94c3-4732-8e89-90094f46c1dc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.228353 May 17 22:11:40.508184 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 193/389] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:40 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:40.674947 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7c0399b0-7abc-428d-8a69-5778555139c8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:40.677125 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7c0399b0-7abc-428d-8a69-5778555139c8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:40.702274 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c0399b0-7abc-428d-8a69-5778555139c8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:40.702750 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c0399b0-7abc-428d-8a69-5778555139c8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:40.703593 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c0399b0-7abc-428d-8a69-5778555139c8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:40.704036 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c0399b0-7abc-428d-8a69-5778555139c8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:40.715819 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c08b757e-7862-4df3-97b8-ea5f3ee7fdc8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:40.729292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c08b757e-7862-4df3-97b8-ea5f3ee7fdc8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:40.735800 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c08b757e-7862-4df3-97b8-ea5f3ee7fdc8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:40.740380 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c08b757e-7862-4df3-97b8-ea5f3ee7fdc8 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.346306 May 17 22:11:40.744202 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 197/390] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:40 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:11:41.025465 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d4f638eb-c8f2-43d0-82dd-b897ec3f48de tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:41.026197 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d4f638eb-c8f2-43d0-82dd-b897ec3f48de tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:41.037037 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d4f638eb-c8f2-43d0-82dd-b897ec3f48de tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:41.037491 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d4f638eb-c8f2-43d0-82dd-b897ec3f48de tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:41.040597 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d4f638eb-c8f2-43d0-82dd-b897ec3f48de tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:41.041038 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d4f638eb-c8f2-43d0-82dd-b897ec3f48de tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:41.269969 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7c0399b0-7abc-428d-8a69-5778555139c8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:41.282033 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7c0399b0-7abc-428d-8a69-5778555139c8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.615648 May 17 22:11:41.282984 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 194/391] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:40 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:41.296581 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6f8f3b37-d53e-4376-a731-5ed3803fc54b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:41.297213 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6f8f3b37-d53e-4376-a731-5ed3803fc54b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:41.303688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f8f3b37-d53e-4376-a731-5ed3803fc54b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:41.304351 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f8f3b37-d53e-4376-a731-5ed3803fc54b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:41.304915 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f8f3b37-d53e-4376-a731-5ed3803fc54b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:41.305355 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f8f3b37-d53e-4376-a731-5ed3803fc54b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:41.384767 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d4f638eb-c8f2-43d0-82dd-b897ec3f48de tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:41.393822 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d4f638eb-c8f2-43d0-82dd-b897ec3f48de tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.372690 May 17 22:11:41.394401 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 198/392] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:41 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:41.411363 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-b2c485ac-5b81-46a8-b773-072da3cb9354 req-87e624e6-5de0-403f-9c08-48560b500c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3e521e-c843-4727-8c31-00c86e4e6aa0", "name": "network-vif-plugged", "status": "completed", "tag": "ea82fbfe-827c-4d08-a78d-a544d7f86c1c"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:41.416276 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-b2c485ac-5b81-46a8-b773-072da3cb9354 req-87e624e6-5de0-403f-9c08-48560b500c49 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:41.417060 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-b2c485ac-5b81-46a8-b773-072da3cb9354 req-87e624e6-5de0-403f-9c08-48560b500c49 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:41.430109 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-b2c485ac-5b81-46a8-b773-072da3cb9354 req-87e624e6-5de0-403f-9c08-48560b500c49 service nova] Creating event network-vif-plugged:ea82fbfe-827c-4d08-a78d-a544d7f86c1c for instance da3e521e-c843-4727-8c31-00c86e4e6aa0 on hv-cinder-83998 May 17 22:11:41.436684 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-b2c485ac-5b81-46a8-b773-072da3cb9354 req-87e624e6-5de0-403f-9c08-48560b500c49 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040854 May 17 22:11:41.437704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 199/393] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:11:41.518665 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-07a48f56-e8b5-4d89-ad2e-cfa8a019f717 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:41.521133 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-07a48f56-e8b5-4d89-ad2e-cfa8a019f717 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:41.544772 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-07a48f56-e8b5-4d89-ad2e-cfa8a019f717 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:41.544965 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-07a48f56-e8b5-4d89-ad2e-cfa8a019f717 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:41.546774 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-07a48f56-e8b5-4d89-ad2e-cfa8a019f717 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:41.548375 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-07a48f56-e8b5-4d89-ad2e-cfa8a019f717 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:41.594085 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6f8f3b37-d53e-4376-a731-5ed3803fc54b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:41.605302 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6f8f3b37-d53e-4376-a731-5ed3803fc54b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.321338 May 17 22:11:41.616210 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 195/394] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:41 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:41.728562 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-07a48f56-e8b5-4d89-ad2e-cfa8a019f717 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:41.740637 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-07a48f56-e8b5-4d89-ad2e-cfa8a019f717 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.228684 May 17 22:11:41.743611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 200/395] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:41 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:41.760004 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1a58ee00-7df1-4c40-9609-5c1787ce9877 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:41.760637 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1a58ee00-7df1-4c40-9609-5c1787ce9877 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:41.767240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a58ee00-7df1-4c40-9609-5c1787ce9877 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:41.767948 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a58ee00-7df1-4c40-9609-5c1787ce9877 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:41.768805 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a58ee00-7df1-4c40-9609-5c1787ce9877 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:41.769235 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1a58ee00-7df1-4c40-9609-5c1787ce9877 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:41.939478 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1a58ee00-7df1-4c40-9609-5c1787ce9877 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:41.948142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1a58ee00-7df1-4c40-9609-5c1787ce9877 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:41.950610 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1a58ee00-7df1-4c40-9609-5c1787ce9877 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:41.951966 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1a58ee00-7df1-4c40-9609-5c1787ce9877 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.196440 May 17 22:11:41.952602 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 196/396] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:41 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:11:42.348029 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2848fe4f-44e3-4080-a2e0-3aadaf7f58d5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:42.348029 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2848fe4f-44e3-4080-a2e0-3aadaf7f58d5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:42.348029 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2848fe4f-44e3-4080-a2e0-3aadaf7f58d5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:42.348029 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2848fe4f-44e3-4080-a2e0-3aadaf7f58d5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:42.349000 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2848fe4f-44e3-4080-a2e0-3aadaf7f58d5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:42.349000 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2848fe4f-44e3-4080-a2e0-3aadaf7f58d5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:42.419270 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-26be888c-aba3-4bcc-9172-3147adfa897b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:42.420760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-26be888c-aba3-4bcc-9172-3147adfa897b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:42.437063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-26be888c-aba3-4bcc-9172-3147adfa897b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:42.437787 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-26be888c-aba3-4bcc-9172-3147adfa897b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:42.438742 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-26be888c-aba3-4bcc-9172-3147adfa897b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:42.439372 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-26be888c-aba3-4bcc-9172-3147adfa897b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:42.454382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2848fe4f-44e3-4080-a2e0-3aadaf7f58d5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:42.464517 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2848fe4f-44e3-4080-a2e0-3aadaf7f58d5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.167964 May 17 22:11:42.466248 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 201/397] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:42 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:42.629761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c50fb6f5-9a50-4548-918d-1860ad7ef262 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:42.631615 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c50fb6f5-9a50-4548-918d-1860ad7ef262 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:42.635286 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-26be888c-aba3-4bcc-9172-3147adfa897b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:42.638818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c50fb6f5-9a50-4548-918d-1860ad7ef262 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:42.639280 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c50fb6f5-9a50-4548-918d-1860ad7ef262 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:42.640065 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c50fb6f5-9a50-4548-918d-1860ad7ef262 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:42.640576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c50fb6f5-9a50-4548-918d-1860ad7ef262 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:42.643446 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-26be888c-aba3-4bcc-9172-3147adfa897b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.236042 May 17 22:11:42.644031 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 197/398] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:42 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:42.764408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f2e1b227-09cf-4a70-9aba-a620a8e79d47 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:42.765183 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f2e1b227-09cf-4a70-9aba-a620a8e79d47 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:42.771969 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2e1b227-09cf-4a70-9aba-a620a8e79d47 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:42.772410 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2e1b227-09cf-4a70-9aba-a620a8e79d47 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:42.773371 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2e1b227-09cf-4a70-9aba-a620a8e79d47 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:42.773803 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f2e1b227-09cf-4a70-9aba-a620a8e79d47 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:42.793344 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c50fb6f5-9a50-4548-918d-1860ad7ef262 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:42.802033 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c50fb6f5-9a50-4548-918d-1860ad7ef262 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.176172 May 17 22:11:42.803390 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 202/399] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:42 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:42.948201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f2e1b227-09cf-4a70-9aba-a620a8e79d47 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:42.955657 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f2e1b227-09cf-4a70-9aba-a620a8e79d47 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.198475 May 17 22:11:42.956229 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 198/400] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:42 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:42.970390 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7f9d8ddc-c9c2-4385-b2b4-599a1c426316 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:42.973909 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7f9d8ddc-c9c2-4385-b2b4-599a1c426316 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:42.981056 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f9d8ddc-c9c2-4385-b2b4-599a1c426316 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:42.981881 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f9d8ddc-c9c2-4385-b2b4-599a1c426316 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:42.982922 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f9d8ddc-c9c2-4385-b2b4-599a1c426316 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:42.983598 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f9d8ddc-c9c2-4385-b2b4-599a1c426316 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:43.119744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7f9d8ddc-c9c2-4385-b2b4-599a1c426316 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:43.128169 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7f9d8ddc-c9c2-4385-b2b4-599a1c426316 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:43.129696 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7f9d8ddc-c9c2-4385-b2b4-599a1c426316 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:43.136198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7f9d8ddc-c9c2-4385-b2b4-599a1c426316 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.164701 May 17 22:11:43.136198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 203/401] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:42 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:43.484278 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3a6074ac-da1a-4706-b4d7-ae005016182e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:43.484852 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3a6074ac-da1a-4706-b4d7-ae005016182e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:43.490868 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3a6074ac-da1a-4706-b4d7-ae005016182e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:43.491352 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3a6074ac-da1a-4706-b4d7-ae005016182e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:43.492105 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3a6074ac-da1a-4706-b4d7-ae005016182e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:43.492531 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3a6074ac-da1a-4706-b4d7-ae005016182e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:43.650742 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3a6074ac-da1a-4706-b4d7-ae005016182e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:43.660683 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3a6074ac-da1a-4706-b4d7-ae005016182e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.179794 May 17 22:11:43.660683 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 199/402] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:43 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:43.669171 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-154036f8-445f-43b4-be46-8d3b67323edc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:43.669852 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-154036f8-445f-43b4-be46-8d3b67323edc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:43.675827 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-154036f8-445f-43b4-be46-8d3b67323edc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:43.676353 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-154036f8-445f-43b4-be46-8d3b67323edc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:43.677135 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-154036f8-445f-43b4-be46-8d3b67323edc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:43.677606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-154036f8-445f-43b4-be46-8d3b67323edc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:43.820813 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4901d3d5-6a23-481f-9fbb-84f38e96d9d4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:43.821919 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4901d3d5-6a23-481f-9fbb-84f38e96d9d4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:43.827043 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-154036f8-445f-43b4-be46-8d3b67323edc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:43.835065 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-154036f8-445f-43b4-be46-8d3b67323edc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.177543 May 17 22:11:43.838044 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 204/403] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:43 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:43.838164 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4901d3d5-6a23-481f-9fbb-84f38e96d9d4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:43.838164 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4901d3d5-6a23-481f-9fbb-84f38e96d9d4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:43.838164 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4901d3d5-6a23-481f-9fbb-84f38e96d9d4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:43.838164 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4901d3d5-6a23-481f-9fbb-84f38e96d9d4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:43.988114 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1d933ea7-f554-4397-83f0-a516d616098d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:43.990466 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1d933ea7-f554-4397-83f0-a516d616098d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:43.997855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d933ea7-f554-4397-83f0-a516d616098d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:43.998642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d933ea7-f554-4397-83f0-a516d616098d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:43.999831 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d933ea7-f554-4397-83f0-a516d616098d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:44.000462 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d933ea7-f554-4397-83f0-a516d616098d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:44.008594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4901d3d5-6a23-481f-9fbb-84f38e96d9d4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:44.018489 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4901d3d5-6a23-481f-9fbb-84f38e96d9d4 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.201614 May 17 22:11:44.019504 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 200/404] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:43 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:44.148976 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-df5dca18-2d45-4c54-8d1e-2592492e99f1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:44.149612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-df5dca18-2d45-4c54-8d1e-2592492e99f1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:44.156281 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df5dca18-2d45-4c54-8d1e-2592492e99f1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:44.156730 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df5dca18-2d45-4c54-8d1e-2592492e99f1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:44.157760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df5dca18-2d45-4c54-8d1e-2592492e99f1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:44.158197 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df5dca18-2d45-4c54-8d1e-2592492e99f1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:44.198573 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1d933ea7-f554-4397-83f0-a516d616098d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:44.198573 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1d933ea7-f554-4397-83f0-a516d616098d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.193867 May 17 22:11:44.198573 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 205/405] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:43 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:44.329534 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-df5dca18-2d45-4c54-8d1e-2592492e99f1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:44.335394 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-df5dca18-2d45-4c54-8d1e-2592492e99f1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:44.337778 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-df5dca18-2d45-4c54-8d1e-2592492e99f1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:44.338056 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-df5dca18-2d45-4c54-8d1e-2592492e99f1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.193120 May 17 22:11:44.338623 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 201/406] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:44 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:11:44.677048 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4ff037f0-70eb-40fa-b991-c61e524cde66 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:44.677752 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4ff037f0-70eb-40fa-b991-c61e524cde66 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:44.684036 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ff037f0-70eb-40fa-b991-c61e524cde66 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:44.685072 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ff037f0-70eb-40fa-b991-c61e524cde66 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:44.685979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ff037f0-70eb-40fa-b991-c61e524cde66 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:44.686506 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4ff037f0-70eb-40fa-b991-c61e524cde66 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:44.848124 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4ff037f0-70eb-40fa-b991-c61e524cde66 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:44.853289 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eda487e6-f0f5-4e08-a4e2-96a59f24e13e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:44.853895 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eda487e6-f0f5-4e08-a4e2-96a59f24e13e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:44.857156 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4ff037f0-70eb-40fa-b991-c61e524cde66 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.183957 May 17 22:11:44.857735 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 206/407] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:44 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:44.861443 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eda487e6-f0f5-4e08-a4e2-96a59f24e13e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:44.861893 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eda487e6-f0f5-4e08-a4e2-96a59f24e13e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:44.862664 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eda487e6-f0f5-4e08-a4e2-96a59f24e13e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:44.863095 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eda487e6-f0f5-4e08-a4e2-96a59f24e13e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:45.012661 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eda487e6-f0f5-4e08-a4e2-96a59f24e13e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:45.020906 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eda487e6-f0f5-4e08-a4e2-96a59f24e13e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.171701 May 17 22:11:45.032092 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 202/408] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:44 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:45.036310 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-80fbc8ca-13d8-4ed2-b249-e2006ae1bc29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:45.037224 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-80fbc8ca-13d8-4ed2-b249-e2006ae1bc29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:45.044153 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80fbc8ca-13d8-4ed2-b249-e2006ae1bc29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:45.044696 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80fbc8ca-13d8-4ed2-b249-e2006ae1bc29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:45.045718 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80fbc8ca-13d8-4ed2-b249-e2006ae1bc29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:45.046231 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-80fbc8ca-13d8-4ed2-b249-e2006ae1bc29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:45.193052 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-80fbc8ca-13d8-4ed2-b249-e2006ae1bc29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:45.201033 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-80fbc8ca-13d8-4ed2-b249-e2006ae1bc29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.169251 May 17 22:11:45.201533 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 207/409] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:45 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:45.214136 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6cd7c8af-77ec-42ee-b728-807b597f1fab tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:45.215387 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6cd7c8af-77ec-42ee-b728-807b597f1fab tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:45.222165 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6cd7c8af-77ec-42ee-b728-807b597f1fab tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:45.222642 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6cd7c8af-77ec-42ee-b728-807b597f1fab tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:45.223684 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6cd7c8af-77ec-42ee-b728-807b597f1fab tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:45.224124 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6cd7c8af-77ec-42ee-b728-807b597f1fab tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:45.358422 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0a862194-4b54-4731-84c1-ba055561135e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:45.359349 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0a862194-4b54-4731-84c1-ba055561135e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:45.382831 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a862194-4b54-4731-84c1-ba055561135e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:45.383207 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a862194-4b54-4731-84c1-ba055561135e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:45.383989 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a862194-4b54-4731-84c1-ba055561135e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:45.384425 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a862194-4b54-4731-84c1-ba055561135e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:45.391606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6cd7c8af-77ec-42ee-b728-807b597f1fab tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:45.399540 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6cd7c8af-77ec-42ee-b728-807b597f1fab tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.189132 May 17 22:11:45.410539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 203/410] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:45 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:45.537872 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0a862194-4b54-4731-84c1-ba055561135e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:45.547268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0a862194-4b54-4731-84c1-ba055561135e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:45.549293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0a862194-4b54-4731-84c1-ba055561135e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:45.550906 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0a862194-4b54-4731-84c1-ba055561135e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.196858 May 17 22:11:45.551610 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 208/411] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:45 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:11:45.875997 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1dee474d-6545-4657-8c85-3c5a91f0ffa4 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:45.877588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1dee474d-6545-4657-8c85-3c5a91f0ffa4 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:45.884139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1dee474d-6545-4657-8c85-3c5a91f0ffa4 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:45.887409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1dee474d-6545-4657-8c85-3c5a91f0ffa4 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:45.887409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1dee474d-6545-4657-8c85-3c5a91f0ffa4 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:45.887409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1dee474d-6545-4657-8c85-3c5a91f0ffa4 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:46.039454 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-64c57eb3-6bc5-4d1d-ad64-a77e6ee86524 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:46.040884 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-64c57eb3-6bc5-4d1d-ad64-a77e6ee86524 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:46.048473 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64c57eb3-6bc5-4d1d-ad64-a77e6ee86524 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:46.049200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64c57eb3-6bc5-4d1d-ad64-a77e6ee86524 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:46.050454 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64c57eb3-6bc5-4d1d-ad64-a77e6ee86524 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:46.051059 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64c57eb3-6bc5-4d1d-ad64-a77e6ee86524 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:46.064437 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1dee474d-6545-4657-8c85-3c5a91f0ffa4 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:46.076871 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1dee474d-6545-4657-8c85-3c5a91f0ffa4 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.205896 May 17 22:11:46.086349 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 204/412] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:45 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:46.200197 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-64c57eb3-6bc5-4d1d-ad64-a77e6ee86524 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:46.209469 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-64c57eb3-6bc5-4d1d-ad64-a77e6ee86524 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.174089 May 17 22:11:46.210413 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 209/413] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:46 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:46.217742 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c0906ade-a5a6-4561-8241-6d7e3b93ed07 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:46.218590 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c0906ade-a5a6-4561-8241-6d7e3b93ed07 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:46.224821 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c0906ade-a5a6-4561-8241-6d7e3b93ed07 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:46.225262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c0906ade-a5a6-4561-8241-6d7e3b93ed07 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:46.226023 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c0906ade-a5a6-4561-8241-6d7e3b93ed07 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:46.226448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c0906ade-a5a6-4561-8241-6d7e3b93ed07 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:46.364969 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c0906ade-a5a6-4561-8241-6d7e3b93ed07 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:46.372583 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c0906ade-a5a6-4561-8241-6d7e3b93ed07 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.158814 May 17 22:11:46.373201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 205/414] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:46 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:46.417625 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c0264cb0-bbf3-4f64-9057-40d70c85860c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:46.418849 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c0264cb0-bbf3-4f64-9057-40d70c85860c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:46.429911 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c0264cb0-bbf3-4f64-9057-40d70c85860c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:46.430384 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c0264cb0-bbf3-4f64-9057-40d70c85860c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:46.431380 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c0264cb0-bbf3-4f64-9057-40d70c85860c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:46.432357 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c0264cb0-bbf3-4f64-9057-40d70c85860c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:46.570009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0d0adf76-680d-4714-9405-7a03213a78a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:46.570503 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0d0adf76-680d-4714-9405-7a03213a78a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:46.578632 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0d0adf76-680d-4714-9405-7a03213a78a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:46.579215 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0d0adf76-680d-4714-9405-7a03213a78a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:46.580345 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0d0adf76-680d-4714-9405-7a03213a78a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:46.580976 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0d0adf76-680d-4714-9405-7a03213a78a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:46.604506 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c0264cb0-bbf3-4f64-9057-40d70c85860c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:46.614934 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c0264cb0-bbf3-4f64-9057-40d70c85860c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.201018 May 17 22:11:46.616520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 210/415] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:46 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:46.740115 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0d0adf76-680d-4714-9405-7a03213a78a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:46.749682 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0d0adf76-680d-4714-9405-7a03213a78a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:46.751509 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0d0adf76-680d-4714-9405-7a03213a78a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:46.752671 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0d0adf76-680d-4714-9405-7a03213a78a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.186575 May 17 22:11:46.753431 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 206/416] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:46 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:47.094369 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c4257c32-cbec-4e7d-b7d0-14d14214ebe2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:47.095040 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c4257c32-cbec-4e7d-b7d0-14d14214ebe2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:47.102459 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4257c32-cbec-4e7d-b7d0-14d14214ebe2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:47.103257 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4257c32-cbec-4e7d-b7d0-14d14214ebe2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:47.104799 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4257c32-cbec-4e7d-b7d0-14d14214ebe2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:47.106599 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4257c32-cbec-4e7d-b7d0-14d14214ebe2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:47.228760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7e70a0ea-2c65-4ca0-91c9-a25f5d77a9e6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:47.231808 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7e70a0ea-2c65-4ca0-91c9-a25f5d77a9e6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:47.239452 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7e70a0ea-2c65-4ca0-91c9-a25f5d77a9e6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:47.239905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7e70a0ea-2c65-4ca0-91c9-a25f5d77a9e6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:47.240687 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7e70a0ea-2c65-4ca0-91c9-a25f5d77a9e6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:47.241121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7e70a0ea-2c65-4ca0-91c9-a25f5d77a9e6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:47.270948 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c4257c32-cbec-4e7d-b7d0-14d14214ebe2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:47.276195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c4257c32-cbec-4e7d-b7d0-14d14214ebe2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1724 microversion: 2.1 time: 0.186204 May 17 22:11:47.276761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 211/417] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:47 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:47.378179 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7e70a0ea-2c65-4ca0-91c9-a25f5d77a9e6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:47.385545 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7e70a0ea-2c65-4ca0-91c9-a25f5d77a9e6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.161854 May 17 22:11:47.386154 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 207/418] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:47 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:47.390016 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0e903117-b37d-4b5a-8de7-f92a44beedd5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:47.390818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0e903117-b37d-4b5a-8de7-f92a44beedd5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:47.397938 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0e903117-b37d-4b5a-8de7-f92a44beedd5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:47.403260 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0e903117-b37d-4b5a-8de7-f92a44beedd5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:47.403260 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0e903117-b37d-4b5a-8de7-f92a44beedd5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:47.403260 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0e903117-b37d-4b5a-8de7-f92a44beedd5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:47.534657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0e903117-b37d-4b5a-8de7-f92a44beedd5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:47.538142 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0e903117-b37d-4b5a-8de7-f92a44beedd5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.152363 May 17 22:11:47.538707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 212/419] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:47 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:47.632206 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4830d748-0902-4cc3-b46a-c58651000e61 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:47.632815 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4830d748-0902-4cc3-b46a-c58651000e61 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:47.638961 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4830d748-0902-4cc3-b46a-c58651000e61 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:47.639448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4830d748-0902-4cc3-b46a-c58651000e61 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:47.640261 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4830d748-0902-4cc3-b46a-c58651000e61 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:47.640692 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4830d748-0902-4cc3-b46a-c58651000e61 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:47.770741 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-71f52b6e-8231-4329-82f3-85a395d31b52 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:47.771365 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-71f52b6e-8231-4329-82f3-85a395d31b52 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:47.778264 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71f52b6e-8231-4329-82f3-85a395d31b52 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:47.779854 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71f52b6e-8231-4329-82f3-85a395d31b52 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:47.779854 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71f52b6e-8231-4329-82f3-85a395d31b52 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:47.780041 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71f52b6e-8231-4329-82f3-85a395d31b52 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:47.807716 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4830d748-0902-4cc3-b46a-c58651000e61 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:47.827712 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4830d748-0902-4cc3-b46a-c58651000e61 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.198983 May 17 22:11:47.836962 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 208/420] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:47 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:48.001789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-71f52b6e-8231-4329-82f3-85a395d31b52 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:48.019203 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-71f52b6e-8231-4329-82f3-85a395d31b52 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:48.020968 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-71f52b6e-8231-4329-82f3-85a395d31b52 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:48.022159 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-71f52b6e-8231-4329-82f3-85a395d31b52 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.255529 May 17 22:11:48.026757 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 213/421] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:47 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:11:48.297098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-79fd534d-ac38-4f7c-a062-6b35259982c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:48.297798 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-79fd534d-ac38-4f7c-a062-6b35259982c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:48.315012 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79fd534d-ac38-4f7c-a062-6b35259982c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:48.315962 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79fd534d-ac38-4f7c-a062-6b35259982c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:48.341327 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79fd534d-ac38-4f7c-a062-6b35259982c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:48.342412 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-79fd534d-ac38-4f7c-a062-6b35259982c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:48.405753 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-17035fa3-71e1-4713-982b-7ac057c142d6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:48.407306 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-17035fa3-71e1-4713-982b-7ac057c142d6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:48.442579 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-17035fa3-71e1-4713-982b-7ac057c142d6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:48.443704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-17035fa3-71e1-4713-982b-7ac057c142d6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:48.446484 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-17035fa3-71e1-4713-982b-7ac057c142d6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:48.447035 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-17035fa3-71e1-4713-982b-7ac057c142d6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:48.649791 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-79fd534d-ac38-4f7c-a062-6b35259982c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:48.659245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-79fd534d-ac38-4f7c-a062-6b35259982c0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1701 microversion: 2.1 time: 0.368715 May 17 22:11:48.660543 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 209/422] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:48 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1701 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:48.664381 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-17035fa3-71e1-4713-982b-7ac057c142d6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:48.665600 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-28431326-2f2f-4fed-8fb8-f516a6e55f13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:48.666406 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-28431326-2f2f-4fed-8fb8-f516a6e55f13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:48.673381 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-17035fa3-71e1-4713-982b-7ac057c142d6 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.275450 May 17 22:11:48.674113 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-28431326-2f2f-4fed-8fb8-f516a6e55f13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:48.674776 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 214/423] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:48 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:48.679091 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-28431326-2f2f-4fed-8fb8-f516a6e55f13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:48.680186 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-28431326-2f2f-4fed-8fb8-f516a6e55f13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:48.680979 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-28431326-2f2f-4fed-8fb8-f516a6e55f13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:48.692289 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7c27513e-f8cc-4b7f-a802-e9bc0b35e477 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:48.705998 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c27513e-f8cc-4b7f-a802-e9bc0b35e477 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:48.706946 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c27513e-f8cc-4b7f-a802-e9bc0b35e477 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:48.740239 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7c27513e-f8cc-4b7f-a802-e9bc0b35e477 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Going to try to start instance {{(pid=117593) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 22:11:48.935732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7c27513e-f8cc-4b7f-a802-e9bc0b35e477 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "POST /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/action" status: 202 len: 0 microversion: 2.1 time: 0.259256 May 17 22:11:48.936734 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 215/424] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:11:48 2022] POST /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:11:48.948253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a154f4bf-260f-413a-ad91-4e7e83d9bfff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:48.951784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a154f4bf-260f-413a-ad91-4e7e83d9bfff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:48.960441 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a154f4bf-260f-413a-ad91-4e7e83d9bfff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:48.961144 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a154f4bf-260f-413a-ad91-4e7e83d9bfff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:48.962836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a154f4bf-260f-413a-ad91-4e7e83d9bfff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:48.963320 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a154f4bf-260f-413a-ad91-4e7e83d9bfff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:49.009157 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-28431326-2f2f-4fed-8fb8-f516a6e55f13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:49.018054 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-28431326-2f2f-4fed-8fb8-f516a6e55f13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.356265 May 17 22:11:49.022616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 210/425] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:48 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:49.029361 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a6895e2d-811f-46f9-a329-133f3b8dd945 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:49.030238 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a6895e2d-811f-46f9-a329-133f3b8dd945 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:49.036640 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6895e2d-811f-46f9-a329-133f3b8dd945 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:49.037365 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6895e2d-811f-46f9-a329-133f3b8dd945 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:49.038402 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6895e2d-811f-46f9-a329-133f3b8dd945 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:49.039199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6895e2d-811f-46f9-a329-133f3b8dd945 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:49.245849 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a154f4bf-260f-413a-ad91-4e7e83d9bfff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:49.256055 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a154f4bf-260f-413a-ad91-4e7e83d9bfff tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.318053 May 17 22:11:49.266321 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 216/426] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:48 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:49.271685 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-93bb0393-d57e-42fe-9e85-94a975f57f02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:49.272299 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-93bb0393-d57e-42fe-9e85-94a975f57f02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:49.280750 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93bb0393-d57e-42fe-9e85-94a975f57f02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:49.281206 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93bb0393-d57e-42fe-9e85-94a975f57f02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:49.282051 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93bb0393-d57e-42fe-9e85-94a975f57f02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:49.282502 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-93bb0393-d57e-42fe-9e85-94a975f57f02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:49.317216 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a6895e2d-811f-46f9-a329-133f3b8dd945 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:49.337206 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a6895e2d-811f-46f9-a329-133f3b8dd945 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1710 microversion: 2.1 time: 0.308143 May 17 22:11:49.337206 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 211/427] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:49 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1710 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:49.737131 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4869c448-3385-4ad6-bfc3-caf1f09da393 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:49.737131 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4869c448-3385-4ad6-bfc3-caf1f09da393 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:49.737131 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4869c448-3385-4ad6-bfc3-caf1f09da393 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:49.737131 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4869c448-3385-4ad6-bfc3-caf1f09da393 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:49.738332 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4869c448-3385-4ad6-bfc3-caf1f09da393 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:49.738332 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4869c448-3385-4ad6-bfc3-caf1f09da393 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:49.738506 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-93bb0393-d57e-42fe-9e85-94a975f57f02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:49.747519 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-93bb0393-d57e-42fe-9e85-94a975f57f02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:49.752258 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-93bb0393-d57e-42fe-9e85-94a975f57f02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:49.755353 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-93bb0393-d57e-42fe-9e85-94a975f57f02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.487893 May 17 22:11:49.758192 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 217/428] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:49 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:49.897310 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4869c448-3385-4ad6-bfc3-caf1f09da393 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:49.907495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4869c448-3385-4ad6-bfc3-caf1f09da393 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.219635 May 17 22:11:49.908647 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 212/429] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:49 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:50.041941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-53ac5ee3-f584-4601-b357-b159cc439f8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:50.043785 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-53ac5ee3-f584-4601-b357-b159cc439f8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:50.052054 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53ac5ee3-f584-4601-b357-b159cc439f8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:50.055452 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53ac5ee3-f584-4601-b357-b159cc439f8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:50.055452 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53ac5ee3-f584-4601-b357-b159cc439f8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:50.055452 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53ac5ee3-f584-4601-b357-b159cc439f8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:50.249020 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-53ac5ee3-f584-4601-b357-b159cc439f8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:50.257002 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-53ac5ee3-f584-4601-b357-b159cc439f8c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1372 microversion: 2.1 time: 0.220718 May 17 22:11:50.257503 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 218/430] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:50 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:50.272526 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-346d4da3-d6ac-48eb-b458-b077a32c7cd1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:50.273384 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-346d4da3-d6ac-48eb-b458-b077a32c7cd1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:50.279324 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-346d4da3-d6ac-48eb-b458-b077a32c7cd1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:50.279985 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-346d4da3-d6ac-48eb-b458-b077a32c7cd1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:50.280941 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-346d4da3-d6ac-48eb-b458-b077a32c7cd1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:50.281353 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-346d4da3-d6ac-48eb-b458-b077a32c7cd1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:50.349954 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3a7c3a32-dc3b-4d69-9290-cc597bf89504 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:50.350555 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3a7c3a32-dc3b-4d69-9290-cc597bf89504 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:50.361037 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3a7c3a32-dc3b-4d69-9290-cc597bf89504 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:50.362082 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3a7c3a32-dc3b-4d69-9290-cc597bf89504 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:50.363513 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3a7c3a32-dc3b-4d69-9290-cc597bf89504 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:50.363513 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3a7c3a32-dc3b-4d69-9290-cc597bf89504 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:50.693838 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-346d4da3-d6ac-48eb-b458-b077a32c7cd1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:50.712653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-346d4da3-d6ac-48eb-b458-b077a32c7cd1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.441703 May 17 22:11:50.721706 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 213/431] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:50 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:50.740284 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3a7c3a32-dc3b-4d69-9290-cc597bf89504 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:50.751006 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3a7c3a32-dc3b-4d69-9290-cc597bf89504 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1710 microversion: 2.1 time: 0.405003 May 17 22:11:50.756117 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 219/432] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:50 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1710 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:50.775629 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9a64abf6-55d8-4511-9af8-6a4ba3431030 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:50.776190 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9a64abf6-55d8-4511-9af8-6a4ba3431030 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:50.799643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9a64abf6-55d8-4511-9af8-6a4ba3431030 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:50.800129 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9a64abf6-55d8-4511-9af8-6a4ba3431030 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:50.800945 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9a64abf6-55d8-4511-9af8-6a4ba3431030 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:50.801373 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9a64abf6-55d8-4511-9af8-6a4ba3431030 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:50.925108 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-73288572-860e-47a9-aa4f-ba19f1c33c61 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:50.926083 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-73288572-860e-47a9-aa4f-ba19f1c33c61 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:50.932446 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-73288572-860e-47a9-aa4f-ba19f1c33c61 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:50.933256 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-73288572-860e-47a9-aa4f-ba19f1c33c61 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:50.943173 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-73288572-860e-47a9-aa4f-ba19f1c33c61 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:50.944282 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-73288572-860e-47a9-aa4f-ba19f1c33c61 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:50.957038 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9a64abf6-55d8-4511-9af8-6a4ba3431030 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:50.972467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9a64abf6-55d8-4511-9af8-6a4ba3431030 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:50.974332 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9a64abf6-55d8-4511-9af8-6a4ba3431030 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:50.976140 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9a64abf6-55d8-4511-9af8-6a4ba3431030 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.204406 May 17 22:11:50.988349 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 214/433] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:50 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:51.241388 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-73288572-860e-47a9-aa4f-ba19f1c33c61 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:51.254766 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-73288572-860e-47a9-aa4f-ba19f1c33c61 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.333710 May 17 22:11:51.255377 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 220/434] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:50 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:51.277108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-68b99040-ed5a-4915-bebc-23dc8d7fa2b9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:51.277707 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-68b99040-ed5a-4915-bebc-23dc8d7fa2b9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:51.284051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-68b99040-ed5a-4915-bebc-23dc8d7fa2b9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:51.284495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-68b99040-ed5a-4915-bebc-23dc8d7fa2b9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:51.285260 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-68b99040-ed5a-4915-bebc-23dc8d7fa2b9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:51.285877 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-68b99040-ed5a-4915-bebc-23dc8d7fa2b9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:51.464776 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-68b99040-ed5a-4915-bebc-23dc8d7fa2b9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:51.476431 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-68b99040-ed5a-4915-bebc-23dc8d7fa2b9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1566 microversion: 2.1 time: 0.203080 May 17 22:11:51.478053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 215/435] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:51 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:51.497961 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fc458761-5ba1-491e-a662-2e460f7793e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:51.501427 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fc458761-5ba1-491e-a662-2e460f7793e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:51.505618 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc458761-5ba1-491e-a662-2e460f7793e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:51.506292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc458761-5ba1-491e-a662-2e460f7793e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:51.507281 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc458761-5ba1-491e-a662-2e460f7793e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:51.507870 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc458761-5ba1-491e-a662-2e460f7793e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:51.615186 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fc458761-5ba1-491e-a662-2e460f7793e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122449 May 17 22:11:51.616260 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 221/436] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 17 22:11:51 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:11:51.735060 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-08738976-3628-40b0-aae7-97bce0ebe9e6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:51.736700 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-08738976-3628-40b0-aae7-97bce0ebe9e6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:51.743410 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08738976-3628-40b0-aae7-97bce0ebe9e6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:51.744149 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08738976-3628-40b0-aae7-97bce0ebe9e6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:51.745143 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08738976-3628-40b0-aae7-97bce0ebe9e6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:51.745793 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-08738976-3628-40b0-aae7-97bce0ebe9e6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:51.773761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-32c5c341-99bf-4e92-8db3-f1fc1bf50810 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:51.775080 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-32c5c341-99bf-4e92-8db3-f1fc1bf50810 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:51.785727 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32c5c341-99bf-4e92-8db3-f1fc1bf50810 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:51.786476 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32c5c341-99bf-4e92-8db3-f1fc1bf50810 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:51.794402 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32c5c341-99bf-4e92-8db3-f1fc1bf50810 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:51.795184 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32c5c341-99bf-4e92-8db3-f1fc1bf50810 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:52.333471 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-08738976-3628-40b0-aae7-97bce0ebe9e6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:52.336591 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-32c5c341-99bf-4e92-8db3-f1fc1bf50810 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:52.342747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-08738976-3628-40b0-aae7-97bce0ebe9e6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.612302 May 17 22:11:52.347234 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-32c5c341-99bf-4e92-8db3-f1fc1bf50810 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1710 microversion: 2.1 time: 0.577326 May 17 22:11:52.349944 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 222/437] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:51 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1710 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:52.352331 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 216/438] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:51 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:52.358112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8e7ca9a4-f6bc-470f-86b0-57c32074ee6a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:52.359130 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8e7ca9a4-f6bc-470f-86b0-57c32074ee6a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:52.364251 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c1eb999a-e13b-4551-8320-7ebf3240d502 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:52.364873 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c1eb999a-e13b-4551-8320-7ebf3240d502 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:52.366228 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e7ca9a4-f6bc-470f-86b0-57c32074ee6a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:52.366879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e7ca9a4-f6bc-470f-86b0-57c32074ee6a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:52.367885 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e7ca9a4-f6bc-470f-86b0-57c32074ee6a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:52.368629 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e7ca9a4-f6bc-470f-86b0-57c32074ee6a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:52.371468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c1eb999a-e13b-4551-8320-7ebf3240d502 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:52.372269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c1eb999a-e13b-4551-8320-7ebf3240d502 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:52.373059 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c1eb999a-e13b-4551-8320-7ebf3240d502 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:52.373667 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c1eb999a-e13b-4551-8320-7ebf3240d502 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:52.887886 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c1eb999a-e13b-4551-8320-7ebf3240d502 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:52.899838 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8e7ca9a4-f6bc-470f-86b0-57c32074ee6a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:52.901622 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c1eb999a-e13b-4551-8320-7ebf3240d502 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:52.906013 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c1eb999a-e13b-4551-8320-7ebf3240d502 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:52.915332 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c1eb999a-e13b-4551-8320-7ebf3240d502 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.557297 May 17 22:11:52.915332 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 223/439] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:52 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:52.915574 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8e7ca9a4-f6bc-470f-86b0-57c32074ee6a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.560964 May 17 22:11:52.916198 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 217/440] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:52 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:53.372310 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-94b81edc-cb07-47da-8513-4a4d46e19b64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:53.373058 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-94b81edc-cb07-47da-8513-4a4d46e19b64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:53.375578 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f14c866d-3974-4116-9709-159aa41476f5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:53.376222 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f14c866d-3974-4116-9709-159aa41476f5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:53.389095 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f14c866d-3974-4116-9709-159aa41476f5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:53.397077 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f14c866d-3974-4116-9709-159aa41476f5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:53.397236 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94b81edc-cb07-47da-8513-4a4d46e19b64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:53.397236 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94b81edc-cb07-47da-8513-4a4d46e19b64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:53.397236 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94b81edc-cb07-47da-8513-4a4d46e19b64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:53.397236 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94b81edc-cb07-47da-8513-4a4d46e19b64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:53.400551 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f14c866d-3974-4116-9709-159aa41476f5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:53.401004 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f14c866d-3974-4116-9709-159aa41476f5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:54.014930 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f14c866d-3974-4116-9709-159aa41476f5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:54.026332 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f14c866d-3974-4116-9709-159aa41476f5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.661974 May 17 22:11:54.026332 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 224/441] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:53 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:54.029011 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-94b81edc-cb07-47da-8513-4a4d46e19b64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:54.039357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-94b81edc-cb07-47da-8513-4a4d46e19b64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1710 microversion: 2.1 time: 0.674652 May 17 22:11:54.039998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 218/442] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:53 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1710 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:54.044053 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ebb20b17-ac11-4c87-a6df-f6954e188f0e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:54.047788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-93231e81-206c-4a5a-af0f-ed298aa0c7a4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:54.047788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-93231e81-206c-4a5a-af0f-ed298aa0c7a4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:54.048396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ebb20b17-ac11-4c87-a6df-f6954e188f0e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:54.055632 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-93231e81-206c-4a5a-af0f-ed298aa0c7a4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:54.056430 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-93231e81-206c-4a5a-af0f-ed298aa0c7a4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:54.057559 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-93231e81-206c-4a5a-af0f-ed298aa0c7a4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:54.059865 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-93231e81-206c-4a5a-af0f-ed298aa0c7a4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:54.061722 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ebb20b17-ac11-4c87-a6df-f6954e188f0e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:54.064569 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ebb20b17-ac11-4c87-a6df-f6954e188f0e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:54.065495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ebb20b17-ac11-4c87-a6df-f6954e188f0e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:54.066398 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ebb20b17-ac11-4c87-a6df-f6954e188f0e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:54.481010 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-93231e81-206c-4a5a-af0f-ed298aa0c7a4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:54.484768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ebb20b17-ac11-4c87-a6df-f6954e188f0e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:54.498143 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ebb20b17-ac11-4c87-a6df-f6954e188f0e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.469993 May 17 22:11:54.508445 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 225/443] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:54 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:54.509178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-93231e81-206c-4a5a-af0f-ed298aa0c7a4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:54.509178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-93231e81-206c-4a5a-af0f-ed298aa0c7a4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:54.509178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-93231e81-206c-4a5a-af0f-ed298aa0c7a4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.467166 May 17 22:11:54.509479 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 219/444] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:54 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:54.521238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-c100605f-1b87-4e2e-ac34-3515da576261 req-653b2e0a-9f9f-412e-b9d7-f40404e2f267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3e521e-c843-4727-8c31-00c86e4e6aa0", "tag": "ea82fbfe-827c-4d08-a78d-a544d7f86c1c"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:54.530619 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c100605f-1b87-4e2e-ac34-3515da576261 req-653b2e0a-9f9f-412e-b9d7-f40404e2f267 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:54.534441 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c100605f-1b87-4e2e-ac34-3515da576261 req-653b2e0a-9f9f-412e-b9d7-f40404e2f267 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:54.543596 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-c100605f-1b87-4e2e-ac34-3515da576261 req-653b2e0a-9f9f-412e-b9d7-f40404e2f267 service nova] Creating event network-changed:ea82fbfe-827c-4d08-a78d-a544d7f86c1c for instance da3e521e-c843-4727-8c31-00c86e4e6aa0 on hv-cinder-83998 May 17 22:11:54.548711 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-c100605f-1b87-4e2e-ac34-3515da576261 req-653b2e0a-9f9f-412e-b9d7-f40404e2f267 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036784 May 17 22:11:54.549341 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 226/445] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:11:55.041782 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2252c868-6cbc-4160-bc69-6ab055ea3929 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:55.043082 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2252c868-6cbc-4160-bc69-6ab055ea3929 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:55.049603 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2252c868-6cbc-4160-bc69-6ab055ea3929 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:55.058462 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2252c868-6cbc-4160-bc69-6ab055ea3929 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:55.065032 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2252c868-6cbc-4160-bc69-6ab055ea3929 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:55.065032 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2252c868-6cbc-4160-bc69-6ab055ea3929 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:55.065265 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dfa5a969-47da-42cd-b0d3-0073e8a93d26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:55.065265 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dfa5a969-47da-42cd-b0d3-0073e8a93d26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:55.083942 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dfa5a969-47da-42cd-b0d3-0073e8a93d26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:55.084706 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dfa5a969-47da-42cd-b0d3-0073e8a93d26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:55.086974 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dfa5a969-47da-42cd-b0d3-0073e8a93d26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:55.090291 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dfa5a969-47da-42cd-b0d3-0073e8a93d26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:55.383689 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-dfa5a969-47da-42cd-b0d3-0073e8a93d26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:55.394610 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2252c868-6cbc-4160-bc69-6ab055ea3929 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:55.395333 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dfa5a969-47da-42cd-b0d3-0073e8a93d26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1710 microversion: 2.1 time: 0.341015 May 17 22:11:55.396262 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 227/446] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:55 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1710 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:55.405299 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2252c868-6cbc-4160-bc69-6ab055ea3929 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.367347 May 17 22:11:55.411151 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 220/447] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:55 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:55.517320 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4c387f58-750d-4e7f-b451-0b5b44eec3b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:55.518135 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4c387f58-750d-4e7f-b451-0b5b44eec3b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:55.526265 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c387f58-750d-4e7f-b451-0b5b44eec3b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:55.527821 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c387f58-750d-4e7f-b451-0b5b44eec3b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:55.528769 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c387f58-750d-4e7f-b451-0b5b44eec3b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:55.529352 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c387f58-750d-4e7f-b451-0b5b44eec3b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:55.529625 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-94c0d979-f2d0-49d9-a72e-c63a59c436a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:55.530246 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-94c0d979-f2d0-49d9-a72e-c63a59c436a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:55.561209 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94c0d979-f2d0-49d9-a72e-c63a59c436a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:55.561667 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94c0d979-f2d0-49d9-a72e-c63a59c436a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:55.562463 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94c0d979-f2d0-49d9-a72e-c63a59c436a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:55.570335 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94c0d979-f2d0-49d9-a72e-c63a59c436a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:55.763891 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4c387f58-750d-4e7f-b451-0b5b44eec3b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:55.772387 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4c387f58-750d-4e7f-b451-0b5b44eec3b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.259652 May 17 22:11:55.774060 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 228/448] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:55 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:55.786299 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1046224159", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "networks": [{"uuid": "ef31749b-f5c4-461d-bb8a-dab8658195c0"}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:55.869564 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] validate_networks() for [('ef31749b-f5c4-461d-bb8a-dab8658195c0', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:11:55.889962 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-94c0d979-f2d0-49d9-a72e-c63a59c436a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:55.908088 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-94c0d979-f2d0-49d9-a72e-c63a59c436a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:55.911967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-94c0d979-f2d0-49d9-a72e-c63a59c436a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:55.914841 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-94c0d979-f2d0-49d9-a72e-c63a59c436a9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.390184 May 17 22:11:55.916929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 221/449] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:55 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:56.358031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:11:56.366990 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:11:56.367535 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:11:56.367945 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:11:56.368355 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:11:56.380436 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:56.380880 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:56.381673 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:56.382102 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:56.402808 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Getting quotas for project 8cb417f91c56432a9f7d9ef7bcf528f9. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:11:56.407484 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Getting quotas for user 091ee1085f2648649053108559390cd1 and project 8cb417f91c56432a9f7d9ef7bcf528f9. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:11:56.413555 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a339f766-83c7-44f4-87b9-a14f9cbddf7a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:56.415012 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a339f766-83c7-44f4-87b9-a14f9cbddf7a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:56.421049 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:11:56.423543 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a339f766-83c7-44f4-87b9-a14f9cbddf7a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:56.424232 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:11:56.424645 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a339f766-83c7-44f4-87b9-a14f9cbddf7a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:56.425685 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a339f766-83c7-44f4-87b9-a14f9cbddf7a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:56.426376 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a339f766-83c7-44f4-87b9-a14f9cbddf7a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:56.690646 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e31ca648-7aa3-44c6-8251-319922de26d1 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835135 May 17 22:11:56.690646 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 229/450] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:11:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:11:56.690646 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2a7ad731-60f5-4ec2-8c2b-84a718ebf236 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:56.690646 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2a7ad731-60f5-4ec2-8c2b-84a718ebf236 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:56.690646 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2a7ad731-60f5-4ec2-8c2b-84a718ebf236 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:56.692506 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2a7ad731-60f5-4ec2-8c2b-84a718ebf236 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:56.692594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a339f766-83c7-44f4-87b9-a14f9cbddf7a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:56.692687 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2a7ad731-60f5-4ec2-8c2b-84a718ebf236 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:56.692687 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2a7ad731-60f5-4ec2-8c2b-84a718ebf236 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:56.692834 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a339f766-83c7-44f4-87b9-a14f9cbddf7a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1714 microversion: 2.1 time: 0.229524 May 17 22:11:56.692834 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 222/451] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:56 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1714 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:56.692834 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-72e85c65-d2de-43b6-8d87-06f1c8d99cde tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa5c11a8-01ab-48a6-b4a4-a8c8fdca9011", "device": "/dev/sdb"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:56.692834 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-72e85c65-d2de-43b6-8d87-06f1c8d99cde tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:56.693114 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-72e85c65-d2de-43b6-8d87-06f1c8d99cde tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:56.693114 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-72e85c65-d2de-43b6-8d87-06f1c8d99cde tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:56.693114 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-72e85c65-d2de-43b6-8d87-06f1c8d99cde tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:56.693114 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-72e85c65-d2de-43b6-8d87-06f1c8d99cde tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:56.842122 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2a7ad731-60f5-4ec2-8c2b-84a718ebf236 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:56.851804 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2a7ad731-60f5-4ec2-8c2b-84a718ebf236 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.238812 May 17 22:11:56.853114 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 230/452] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:56 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:56.859999 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3297fea0-9f29-416f-a2a3-f10a47e7c3cf tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:56.861106 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3297fea0-9f29-416f-a2a3-f10a47e7c3cf tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:56.932238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3297fea0-9f29-416f-a2a3-f10a47e7c3cf tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:56.940562 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3297fea0-9f29-416f-a2a3-f10a47e7c3cf tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1214 microversion: 2.1 time: 0.086231 May 17 22:11:56.941448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 231/453] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:56 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:56.952031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e662bb57-4271-4619-a594-fe190c8824b9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:56.952877 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e662bb57-4271-4619-a594-fe190c8824b9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:56.958924 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e662bb57-4271-4619-a594-fe190c8824b9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:56.959619 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e662bb57-4271-4619-a594-fe190c8824b9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:56.960757 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e662bb57-4271-4619-a594-fe190c8824b9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:56.961456 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e662bb57-4271-4619-a594-fe190c8824b9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:57.128654 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e662bb57-4271-4619-a594-fe190c8824b9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:57.141154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e662bb57-4271-4619-a594-fe190c8824b9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.193759 May 17 22:11:57.152413 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 232/454] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:56 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:57.161174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4a2611ec-86d6-4da3-86ee-dd07cb37539c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:57.162170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4a2611ec-86d6-4da3-86ee-dd07cb37539c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:57.169941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a2611ec-86d6-4da3-86ee-dd07cb37539c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:57.170731 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a2611ec-86d6-4da3-86ee-dd07cb37539c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:57.171768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a2611ec-86d6-4da3-86ee-dd07cb37539c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:57.172423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a2611ec-86d6-4da3-86ee-dd07cb37539c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:57.336127 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4a2611ec-86d6-4da3-86ee-dd07cb37539c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:57.345605 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4a2611ec-86d6-4da3-86ee-dd07cb37539c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:57.347137 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4a2611ec-86d6-4da3-86ee-dd07cb37539c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:57.348303 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4a2611ec-86d6-4da3-86ee-dd07cb37539c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.194452 May 17 22:11:57.349065 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 233/455] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:57 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:57.645897 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-72e85c65-d2de-43b6-8d87-06f1c8d99cde tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "POST /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.004103 May 17 22:11:57.652308 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 223/456] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:11:56 2022] POST /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc/os-volume_attachments => generated 194 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:11:57.869679 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-62660c8d-c05c-4229-91c1-31b8b396ca13 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:57.871583 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-62660c8d-c05c-4229-91c1-31b8b396ca13 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:57.878753 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62660c8d-c05c-4229-91c1-31b8b396ca13 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:57.886249 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62660c8d-c05c-4229-91c1-31b8b396ca13 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:57.901193 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62660c8d-c05c-4229-91c1-31b8b396ca13 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:57.901193 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62660c8d-c05c-4229-91c1-31b8b396ca13 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:57.959904 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1189e23a-1390-44e4-867f-b724a83d6b81 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:57.960606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1189e23a-1390-44e4-867f-b724a83d6b81 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:57.967848 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1189e23a-1390-44e4-867f-b724a83d6b81 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:57.971875 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1189e23a-1390-44e4-867f-b724a83d6b81 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:57.971875 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1189e23a-1390-44e4-867f-b724a83d6b81 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:57.971875 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1189e23a-1390-44e4-867f-b724a83d6b81 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:58.064370 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1189e23a-1390-44e4-867f-b724a83d6b81 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:58.073211 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1189e23a-1390-44e4-867f-b724a83d6b81 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1218 microversion: 2.1 time: 0.117541 May 17 22:11:58.076055 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 224/457] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:57 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:58.110186 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-62660c8d-c05c-4229-91c1-31b8b396ca13 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:58.122175 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-62660c8d-c05c-4229-91c1-31b8b396ca13 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.255945 May 17 22:11:58.125652 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 234/458] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:57 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:58.161015 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6b7d4fd6-9be1-41f3-b2f4-ea08ec8ef5ce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:58.161731 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6b7d4fd6-9be1-41f3-b2f4-ea08ec8ef5ce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:58.169250 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b7d4fd6-9be1-41f3-b2f4-ea08ec8ef5ce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:58.169753 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b7d4fd6-9be1-41f3-b2f4-ea08ec8ef5ce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:58.172203 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b7d4fd6-9be1-41f3-b2f4-ea08ec8ef5ce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:58.172203 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b7d4fd6-9be1-41f3-b2f4-ea08ec8ef5ce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:58.336326 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6b7d4fd6-9be1-41f3-b2f4-ea08ec8ef5ce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:58.348106 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6b7d4fd6-9be1-41f3-b2f4-ea08ec8ef5ce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.193622 May 17 22:11:58.352082 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 225/459] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:58 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:58.375169 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-16acadca-8b99-49f6-ae9e-80fb3522f03e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:58.376022 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-16acadca-8b99-49f6-ae9e-80fb3522f03e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:58.384114 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-16acadca-8b99-49f6-ae9e-80fb3522f03e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:58.384640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-16acadca-8b99-49f6-ae9e-80fb3522f03e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:58.385413 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-16acadca-8b99-49f6-ae9e-80fb3522f03e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:58.386044 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-16acadca-8b99-49f6-ae9e-80fb3522f03e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:58.541094 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-16acadca-8b99-49f6-ae9e-80fb3522f03e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:58.555764 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-16acadca-8b99-49f6-ae9e-80fb3522f03e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:58.562139 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-16acadca-8b99-49f6-ae9e-80fb3522f03e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:58.563654 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-16acadca-8b99-49f6-ae9e-80fb3522f03e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.200193 May 17 22:11:58.564634 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 235/460] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:58 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:11:59.092924 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1d59591b-a33e-4a9b-97cc-f95b42eb459b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:59.093540 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1d59591b-a33e-4a9b-97cc-f95b42eb459b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:59.100144 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d59591b-a33e-4a9b-97cc-f95b42eb459b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:59.100595 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d59591b-a33e-4a9b-97cc-f95b42eb459b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:59.101369 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d59591b-a33e-4a9b-97cc-f95b42eb459b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:59.101827 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1d59591b-a33e-4a9b-97cc-f95b42eb459b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:59.139741 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1a412f43-e48a-42e8-a35d-b7a513823ddb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:59.141119 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1a412f43-e48a-42e8-a35d-b7a513823ddb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:59.156861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a412f43-e48a-42e8-a35d-b7a513823ddb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:59.157675 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a412f43-e48a-42e8-a35d-b7a513823ddb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:59.158689 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a412f43-e48a-42e8-a35d-b7a513823ddb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:59.159223 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a412f43-e48a-42e8-a35d-b7a513823ddb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:59.174645 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1d59591b-a33e-4a9b-97cc-f95b42eb459b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:59.184127 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1d59591b-a33e-4a9b-97cc-f95b42eb459b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1210 microversion: 2.1 time: 0.094919 May 17 22:11:59.194171 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 226/461] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:59 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:11:59.338017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1a412f43-e48a-42e8-a35d-b7a513823ddb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:59.347921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1a412f43-e48a-42e8-a35d-b7a513823ddb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.212236 May 17 22:11:59.348338 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 236/462] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:59 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:59.351412 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-efbeb1c9-5f7a-46aa-ba82-5d2837138b2d req-2820d6cf-e8dc-4432-85ee-4493cd29431f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429a5e1d-02ff-43b5-a293-584d721f62ca", "name": "network-vif-plugged", "status": "completed", "tag": "b2ca1063-f162-4839-8103-868d1a01da49"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:11:59.370082 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-efbeb1c9-5f7a-46aa-ba82-5d2837138b2d req-2820d6cf-e8dc-4432-85ee-4493cd29431f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:59.370663 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-efbeb1c9-5f7a-46aa-ba82-5d2837138b2d req-2820d6cf-e8dc-4432-85ee-4493cd29431f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:59.372068 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d6fdddbe-9ad7-436e-bfcd-16c05741ab99 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:59.372688 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d6fdddbe-9ad7-436e-bfcd-16c05741ab99 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:59.379157 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d6fdddbe-9ad7-436e-bfcd-16c05741ab99 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:59.379613 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d6fdddbe-9ad7-436e-bfcd-16c05741ab99 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:59.380433 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d6fdddbe-9ad7-436e-bfcd-16c05741ab99 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:59.381099 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d6fdddbe-9ad7-436e-bfcd-16c05741ab99 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:59.384069 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-efbeb1c9-5f7a-46aa-ba82-5d2837138b2d req-2820d6cf-e8dc-4432-85ee-4493cd29431f service nova] Creating event network-vif-plugged:b2ca1063-f162-4839-8103-868d1a01da49 for instance 429a5e1d-02ff-43b5-a293-584d721f62ca on hv-cinder-83998 May 17 22:11:59.389896 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-efbeb1c9-5f7a-46aa-ba82-5d2837138b2d req-2820d6cf-e8dc-4432-85ee-4493cd29431f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042716 May 17 22:11:59.390958 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 227/463] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:11:59.561588 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d6fdddbe-9ad7-436e-bfcd-16c05741ab99 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:59.570782 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d6fdddbe-9ad7-436e-bfcd-16c05741ab99 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.204675 May 17 22:11:59.581076 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 237/464] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:11:59 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:11:59.589903 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0e5a2be4-9ac6-46c9-a1dd-24dba5ce1f98 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:11:59.592995 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0e5a2be4-9ac6-46c9-a1dd-24dba5ce1f98 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:11:59.603877 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0e5a2be4-9ac6-46c9-a1dd-24dba5ce1f98 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:59.603877 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0e5a2be4-9ac6-46c9-a1dd-24dba5ce1f98 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:59.605402 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0e5a2be4-9ac6-46c9-a1dd-24dba5ce1f98 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:11:59.605942 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0e5a2be4-9ac6-46c9-a1dd-24dba5ce1f98 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:11:59.779093 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0e5a2be4-9ac6-46c9-a1dd-24dba5ce1f98 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:59.815360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0e5a2be4-9ac6-46c9-a1dd-24dba5ce1f98 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:59.817261 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0e5a2be4-9ac6-46c9-a1dd-24dba5ce1f98 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:11:59.818444 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0e5a2be4-9ac6-46c9-a1dd-24dba5ce1f98 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.239632 May 17 22:11:59.819011 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 228/465] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:11:59 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:00.202284 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-12b9721b-f572-4fac-a0f7-e2cbee281877 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:00.202967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-12b9721b-f572-4fac-a0f7-e2cbee281877 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:00.209236 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-12b9721b-f572-4fac-a0f7-e2cbee281877 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:00.209689 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-12b9721b-f572-4fac-a0f7-e2cbee281877 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:00.210491 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-12b9721b-f572-4fac-a0f7-e2cbee281877 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:00.210931 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-12b9721b-f572-4fac-a0f7-e2cbee281877 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:00.282573 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-12b9721b-f572-4fac-a0f7-e2cbee281877 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:00.294385 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-12b9721b-f572-4fac-a0f7-e2cbee281877 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1274 microversion: 2.1 time: 0.096350 May 17 22:12:00.294997 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 238/466] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:00 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:00.364001 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0a4c6e16-b05c-410a-896d-ce58c48d57ac tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:00.364572 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0a4c6e16-b05c-410a-896d-ce58c48d57ac tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:00.371924 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a4c6e16-b05c-410a-896d-ce58c48d57ac tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:00.372374 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a4c6e16-b05c-410a-896d-ce58c48d57ac tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:00.373143 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a4c6e16-b05c-410a-896d-ce58c48d57ac tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:00.373605 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0a4c6e16-b05c-410a-896d-ce58c48d57ac tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:00.531986 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0a4c6e16-b05c-410a-896d-ce58c48d57ac tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:00.539526 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0a4c6e16-b05c-410a-896d-ce58c48d57ac tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.179502 May 17 22:12:00.540100 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 229/467] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:00 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:00.588292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0cef23b6-d2d4-41ca-aca7-77b2238d4432 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:00.589602 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0cef23b6-d2d4-41ca-aca7-77b2238d4432 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:00.595618 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0cef23b6-d2d4-41ca-aca7-77b2238d4432 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:00.596068 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0cef23b6-d2d4-41ca-aca7-77b2238d4432 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:00.596846 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0cef23b6-d2d4-41ca-aca7-77b2238d4432 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:00.597287 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0cef23b6-d2d4-41ca-aca7-77b2238d4432 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:00.734075 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0cef23b6-d2d4-41ca-aca7-77b2238d4432 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:00.741681 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0cef23b6-d2d4-41ca-aca7-77b2238d4432 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.157211 May 17 22:12:00.742238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 239/468] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:00 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:00.837200 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-54ffbbcd-e86f-4178-8033-ec2cdd78b847 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:00.838060 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-54ffbbcd-e86f-4178-8033-ec2cdd78b847 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:00.849051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54ffbbcd-e86f-4178-8033-ec2cdd78b847 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:00.849501 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54ffbbcd-e86f-4178-8033-ec2cdd78b847 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:00.850279 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54ffbbcd-e86f-4178-8033-ec2cdd78b847 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:00.850711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54ffbbcd-e86f-4178-8033-ec2cdd78b847 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:01.027643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-54ffbbcd-e86f-4178-8033-ec2cdd78b847 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:01.037944 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-54ffbbcd-e86f-4178-8033-ec2cdd78b847 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:01.039863 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-54ffbbcd-e86f-4178-8033-ec2cdd78b847 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:01.041266 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-54ffbbcd-e86f-4178-8033-ec2cdd78b847 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.208211 May 17 22:12:01.042880 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 230/469] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:00 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:01.312887 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b48568d7-8066-43f1-b851-a0a0f1aced08 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:01.324731 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b48568d7-8066-43f1-b851-a0a0f1aced08 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:01.332259 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b48568d7-8066-43f1-b851-a0a0f1aced08 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:01.332793 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b48568d7-8066-43f1-b851-a0a0f1aced08 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:01.333854 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b48568d7-8066-43f1-b851-a0a0f1aced08 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:01.334364 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b48568d7-8066-43f1-b851-a0a0f1aced08 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:01.411334 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-b1ae50dc-f5f9-4bc8-b7a4-12b4d3cab908 req-c796157a-7b68-4cf8-98ae-5340f889db0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c468659-e42a-4284-9a0c-39aa262bd9a5", "name": "network-vif-plugged", "status": "completed", "tag": "6b82dab7-02cb-4cc1-a078-91095811826f"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:01.438822 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-b1ae50dc-f5f9-4bc8-b7a4-12b4d3cab908 req-c796157a-7b68-4cf8-98ae-5340f889db0a service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:01.440871 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-b1ae50dc-f5f9-4bc8-b7a4-12b4d3cab908 req-c796157a-7b68-4cf8-98ae-5340f889db0a service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:01.467325 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-b1ae50dc-f5f9-4bc8-b7a4-12b4d3cab908 req-c796157a-7b68-4cf8-98ae-5340f889db0a service nova] Creating event network-vif-plugged:6b82dab7-02cb-4cc1-a078-91095811826f for instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 on hv-cinder-83998 May 17 22:12:01.474072 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-b1ae50dc-f5f9-4bc8-b7a4-12b4d3cab908 req-c796157a-7b68-4cf8-98ae-5340f889db0a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069862 May 17 22:12:01.475540 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 231/470] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:01.510256 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b48568d7-8066-43f1-b851-a0a0f1aced08 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:01.531963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b48568d7-8066-43f1-b851-a0a0f1aced08 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1316 microversion: 2.1 time: 0.211375 May 17 22:12:01.531963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 240/471] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:01 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:01.557160 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-09fffd8c-c9a3-40e4-8bc4-d217ae331f48 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:01.558539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-09fffd8c-c9a3-40e4-8bc4-d217ae331f48 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:01.565938 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09fffd8c-c9a3-40e4-8bc4-d217ae331f48 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:01.566394 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09fffd8c-c9a3-40e4-8bc4-d217ae331f48 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:01.567192 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09fffd8c-c9a3-40e4-8bc4-d217ae331f48 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:01.567630 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09fffd8c-c9a3-40e4-8bc4-d217ae331f48 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:01.703118 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-09fffd8c-c9a3-40e4-8bc4-d217ae331f48 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:01.710654 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-09fffd8c-c9a3-40e4-8bc4-d217ae331f48 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1365 microversion: 2.1 time: 0.157634 May 17 22:12:01.711243 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 232/472] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:01 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:01.758210 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-335f7765-6f61-481e-b474-8869254fff25 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:01.758859 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-335f7765-6f61-481e-b474-8869254fff25 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:01.766479 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-335f7765-6f61-481e-b474-8869254fff25 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:01.766938 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-335f7765-6f61-481e-b474-8869254fff25 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:01.768142 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-335f7765-6f61-481e-b474-8869254fff25 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:01.768582 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-335f7765-6f61-481e-b474-8869254fff25 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:01.926683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-335f7765-6f61-481e-b474-8869254fff25 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:01.936604 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-335f7765-6f61-481e-b474-8869254fff25 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.182580 May 17 22:12:01.943799 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 241/473] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:01 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:02.062355 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-44228c01-913f-4cc9-bf8b-bcca670c500e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:02.062952 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-44228c01-913f-4cc9-bf8b-bcca670c500e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:02.068746 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-44228c01-913f-4cc9-bf8b-bcca670c500e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:02.069198 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-44228c01-913f-4cc9-bf8b-bcca670c500e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:02.069962 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-44228c01-913f-4cc9-bf8b-bcca670c500e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:02.070399 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-44228c01-913f-4cc9-bf8b-bcca670c500e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:02.206750 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-44228c01-913f-4cc9-bf8b-bcca670c500e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:02.215331 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-44228c01-913f-4cc9-bf8b-bcca670c500e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:02.216883 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-44228c01-913f-4cc9-bf8b-bcca670c500e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:02.218018 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-44228c01-913f-4cc9-bf8b-bcca670c500e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.161279 May 17 22:12:02.218566 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 233/474] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:02 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:02.307309 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-50e9413f-3f53-492a-9935-f3a84452f032 req-987bd88e-1115-4328-8335-c824abb89669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a06c5d32-8f6a-42d0-8b91-540afe1db580", "tag": "e639faaf-c59e-4dcf-97ac-142d9f2351d2"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:02.316050 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-50e9413f-3f53-492a-9935-f3a84452f032 req-987bd88e-1115-4328-8335-c824abb89669 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:02.316648 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-50e9413f-3f53-492a-9935-f3a84452f032 req-987bd88e-1115-4328-8335-c824abb89669 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:02.328080 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-50e9413f-3f53-492a-9935-f3a84452f032 req-987bd88e-1115-4328-8335-c824abb89669 service nova] Creating event network-changed:e639faaf-c59e-4dcf-97ac-142d9f2351d2 for instance a06c5d32-8f6a-42d0-8b91-540afe1db580 on hv-cinder-83998 May 17 22:12:02.332761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-50e9413f-3f53-492a-9935-f3a84452f032 req-987bd88e-1115-4328-8335-c824abb89669 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029334 May 17 22:12:02.333347 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 242/475] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:12:02.542804 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5acf2b08-2b7e-472e-a61b-10890da4a113 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:02.545475 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5acf2b08-2b7e-472e-a61b-10890da4a113 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:02.550466 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5acf2b08-2b7e-472e-a61b-10890da4a113 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:02.550932 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5acf2b08-2b7e-472e-a61b-10890da4a113 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:02.551738 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5acf2b08-2b7e-472e-a61b-10890da4a113 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:02.552173 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5acf2b08-2b7e-472e-a61b-10890da4a113 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:02.722046 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5acf2b08-2b7e-472e-a61b-10890da4a113 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:02.728875 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fbd5e2dc-3875-4304-b9dd-0e2992f9f0a1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:02.730109 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fbd5e2dc-3875-4304-b9dd-0e2992f9f0a1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:02.732375 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5acf2b08-2b7e-472e-a61b-10890da4a113 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.195645 May 17 22:12:02.732966 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 234/476] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:02 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:02.736335 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fbd5e2dc-3875-4304-b9dd-0e2992f9f0a1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:02.736778 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fbd5e2dc-3875-4304-b9dd-0e2992f9f0a1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:02.737715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fbd5e2dc-3875-4304-b9dd-0e2992f9f0a1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:02.738319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fbd5e2dc-3875-4304-b9dd-0e2992f9f0a1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:02.881746 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fbd5e2dc-3875-4304-b9dd-0e2992f9f0a1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:02.890576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fbd5e2dc-3875-4304-b9dd-0e2992f9f0a1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1555 microversion: 2.1 time: 0.166481 May 17 22:12:02.891170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 243/477] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:02 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:02.906871 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b6fce036-9768-4f4c-88db-d0b869ed8c85 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:02.907395 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b6fce036-9768-4f4c-88db-d0b869ed8c85 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:02.913927 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b6fce036-9768-4f4c-88db-d0b869ed8c85 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:02.914367 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b6fce036-9768-4f4c-88db-d0b869ed8c85 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:02.915135 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b6fce036-9768-4f4c-88db-d0b869ed8c85 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:02.915635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b6fce036-9768-4f4c-88db-d0b869ed8c85 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:02.957438 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-68288276-766d-4ef3-865b-90826cea149d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:02.958036 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-68288276-766d-4ef3-865b-90826cea149d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:02.964783 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68288276-766d-4ef3-865b-90826cea149d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:02.965231 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68288276-766d-4ef3-865b-90826cea149d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:02.966002 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68288276-766d-4ef3-865b-90826cea149d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:02.966596 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68288276-766d-4ef3-865b-90826cea149d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:02.997343 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b6fce036-9768-4f4c-88db-d0b869ed8c85 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094257 May 17 22:12:02.997969 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 235/478] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 17 22:12:02 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:03.103522 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-68288276-766d-4ef3-865b-90826cea149d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:03.111468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-68288276-766d-4ef3-865b-90826cea149d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.158303 May 17 22:12:03.112124 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 244/479] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:02 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:03.236923 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3fec2d78-3bbc-4264-97ed-e119caedc909 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:03.237592 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3fec2d78-3bbc-4264-97ed-e119caedc909 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:03.244051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3fec2d78-3bbc-4264-97ed-e119caedc909 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:03.244502 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3fec2d78-3bbc-4264-97ed-e119caedc909 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:03.245889 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3fec2d78-3bbc-4264-97ed-e119caedc909 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:03.246682 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3fec2d78-3bbc-4264-97ed-e119caedc909 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:03.382834 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3fec2d78-3bbc-4264-97ed-e119caedc909 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:03.392167 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3fec2d78-3bbc-4264-97ed-e119caedc909 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:03.394335 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3fec2d78-3bbc-4264-97ed-e119caedc909 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:03.395679 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3fec2d78-3bbc-4264-97ed-e119caedc909 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1740 microversion: 2.20 time: 0.162854 May 17 22:12:03.396565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 236/480] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:03 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:03.749971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-440df45d-c9f6-439c-aa22-927193827724 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:03.750577 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-440df45d-c9f6-439c-aa22-927193827724 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:03.757020 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-440df45d-c9f6-439c-aa22-927193827724 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:03.757467 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-440df45d-c9f6-439c-aa22-927193827724 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:03.758223 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-440df45d-c9f6-439c-aa22-927193827724 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:03.758652 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-440df45d-c9f6-439c-aa22-927193827724 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:03.894520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-440df45d-c9f6-439c-aa22-927193827724 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:03.902634 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-440df45d-c9f6-439c-aa22-927193827724 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.156873 May 17 22:12:03.903249 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 245/481] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:03 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:04.128607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9f392cf6-a2cc-4935-bfa1-b47698ca10a7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:04.129215 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9f392cf6-a2cc-4935-bfa1-b47698ca10a7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:04.134942 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9f392cf6-a2cc-4935-bfa1-b47698ca10a7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:04.135476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9f392cf6-a2cc-4935-bfa1-b47698ca10a7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:04.136628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9f392cf6-a2cc-4935-bfa1-b47698ca10a7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:04.137050 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9f392cf6-a2cc-4935-bfa1-b47698ca10a7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:04.272595 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9f392cf6-a2cc-4935-bfa1-b47698ca10a7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:04.280148 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9f392cf6-a2cc-4935-bfa1-b47698ca10a7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.156078 May 17 22:12:04.280705 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 237/482] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:04 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:04.346581 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-7c7dcea6-9296-4817-92b1-dabf7e1f88df req-259b538b-7fc3-4be7-9874-edfaf173aeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429a5e1d-02ff-43b5-a293-584d721f62ca", "tag": "b2ca1063-f162-4839-8103-868d1a01da49"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:04.354539 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-7c7dcea6-9296-4817-92b1-dabf7e1f88df req-259b538b-7fc3-4be7-9874-edfaf173aeef service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:04.355083 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-7c7dcea6-9296-4817-92b1-dabf7e1f88df req-259b538b-7fc3-4be7-9874-edfaf173aeef service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:04.365695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-7c7dcea6-9296-4817-92b1-dabf7e1f88df req-259b538b-7fc3-4be7-9874-edfaf173aeef service nova] Creating event network-changed:b2ca1063-f162-4839-8103-868d1a01da49 for instance 429a5e1d-02ff-43b5-a293-584d721f62ca on hv-cinder-83998 May 17 22:12:04.370976 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-7c7dcea6-9296-4817-92b1-dabf7e1f88df req-259b538b-7fc3-4be7-9874-edfaf173aeef service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027525 May 17 22:12:04.371716 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 246/483] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:04.413768 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a1d6fc65-d3f1-4d96-be58-7520905e3efb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:04.414473 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a1d6fc65-d3f1-4d96-be58-7520905e3efb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:04.420668 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1d6fc65-d3f1-4d96-be58-7520905e3efb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:04.421112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1d6fc65-d3f1-4d96-be58-7520905e3efb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:04.421870 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1d6fc65-d3f1-4d96-be58-7520905e3efb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:04.422302 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a1d6fc65-d3f1-4d96-be58-7520905e3efb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:04.643038 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a1d6fc65-d3f1-4d96-be58-7520905e3efb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:04.650721 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a1d6fc65-d3f1-4d96-be58-7520905e3efb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:04.652967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a1d6fc65-d3f1-4d96-be58-7520905e3efb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:04.654116 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a1d6fc65-d3f1-4d96-be58-7520905e3efb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1722 microversion: 2.20 time: 0.244249 May 17 22:12:04.654682 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 238/484] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:04 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:04.921969 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b71c030d-404f-42db-a5a5-fe7faa14a143 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:04.922727 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b71c030d-404f-42db-a5a5-fe7faa14a143 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:04.928764 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b71c030d-404f-42db-a5a5-fe7faa14a143 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:04.929215 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b71c030d-404f-42db-a5a5-fe7faa14a143 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:04.930024 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b71c030d-404f-42db-a5a5-fe7faa14a143 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:04.930882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b71c030d-404f-42db-a5a5-fe7faa14a143 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:05.077054 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b71c030d-404f-42db-a5a5-fe7faa14a143 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:05.084926 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b71c030d-404f-42db-a5a5-fe7faa14a143 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.168209 May 17 22:12:05.085516 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 247/485] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:04 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:05.297735 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bc910882-5e05-4ac1-8cb6-540d48eab26b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:05.298358 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bc910882-5e05-4ac1-8cb6-540d48eab26b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:05.307632 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bc910882-5e05-4ac1-8cb6-540d48eab26b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:05.308202 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bc910882-5e05-4ac1-8cb6-540d48eab26b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:05.308984 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bc910882-5e05-4ac1-8cb6-540d48eab26b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:05.309413 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bc910882-5e05-4ac1-8cb6-540d48eab26b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:05.470099 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bc910882-5e05-4ac1-8cb6-540d48eab26b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:05.478613 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bc910882-5e05-4ac1-8cb6-540d48eab26b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1356 microversion: 2.1 time: 0.184931 May 17 22:12:05.479176 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 239/486] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:05 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1356 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:05.672596 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bfada61e-557c-40c6-a760-b9d8ae991936 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:05.673109 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bfada61e-557c-40c6-a760-b9d8ae991936 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:05.679241 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bfada61e-557c-40c6-a760-b9d8ae991936 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:05.679693 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bfada61e-557c-40c6-a760-b9d8ae991936 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:05.680444 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bfada61e-557c-40c6-a760-b9d8ae991936 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:05.680870 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bfada61e-557c-40c6-a760-b9d8ae991936 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:05.809133 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bfada61e-557c-40c6-a760-b9d8ae991936 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:05.817140 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bfada61e-557c-40c6-a760-b9d8ae991936 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:05.818637 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bfada61e-557c-40c6-a760-b9d8ae991936 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:05.819820 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bfada61e-557c-40c6-a760-b9d8ae991936 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1722 microversion: 2.20 time: 0.151161 May 17 22:12:05.820387 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 248/487] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:05 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:06.101777 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2ce95a98-3c9a-48cc-826a-bc1a8b5a0718 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:06.102572 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2ce95a98-3c9a-48cc-826a-bc1a8b5a0718 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:06.108586 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2ce95a98-3c9a-48cc-826a-bc1a8b5a0718 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:06.109021 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2ce95a98-3c9a-48cc-826a-bc1a8b5a0718 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:06.109774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2ce95a98-3c9a-48cc-826a-bc1a8b5a0718 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:06.110200 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2ce95a98-3c9a-48cc-826a-bc1a8b5a0718 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:06.238563 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2ce95a98-3c9a-48cc-826a-bc1a8b5a0718 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:06.245878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2ce95a98-3c9a-48cc-826a-bc1a8b5a0718 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.148038 May 17 22:12:06.246467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 240/488] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:06 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:06.496413 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-450bec2d-c4af-4885-ba59-d9fd5448982a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:06.497146 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-450bec2d-c4af-4885-ba59-d9fd5448982a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:06.508001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-450bec2d-c4af-4885-ba59-d9fd5448982a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:06.509012 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-450bec2d-c4af-4885-ba59-d9fd5448982a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:06.509806 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-450bec2d-c4af-4885-ba59-d9fd5448982a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:06.510240 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-450bec2d-c4af-4885-ba59-d9fd5448982a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:06.828574 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-450bec2d-c4af-4885-ba59-d9fd5448982a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:06.836299 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-450bec2d-c4af-4885-ba59-d9fd5448982a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1547 microversion: 2.1 time: 0.344636 May 17 22:12:06.837151 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 249/489] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:06 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1547 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:06.838071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-069ea251-434b-40b6-96f3-457d5f2bcc50 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:06.838844 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-069ea251-434b-40b6-96f3-457d5f2bcc50 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:06.847837 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-069ea251-434b-40b6-96f3-457d5f2bcc50 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:06.848527 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-069ea251-434b-40b6-96f3-457d5f2bcc50 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:06.849433 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-069ea251-434b-40b6-96f3-457d5f2bcc50 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:06.850104 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-069ea251-434b-40b6-96f3-457d5f2bcc50 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:06.863156 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1772f536-8fc3-4590-942c-51a756b263c5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:06.863780 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1772f536-8fc3-4590-942c-51a756b263c5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:06.869748 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1772f536-8fc3-4590-942c-51a756b263c5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:06.876773 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1772f536-8fc3-4590-942c-51a756b263c5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:06.876773 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1772f536-8fc3-4590-942c-51a756b263c5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:06.876773 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1772f536-8fc3-4590-942c-51a756b263c5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:07.297982 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-069ea251-434b-40b6-96f3-457d5f2bcc50 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:07.305767 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1772f536-8fc3-4590-942c-51a756b263c5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:07.306332 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-069ea251-434b-40b6-96f3-457d5f2bcc50 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:07.308491 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-069ea251-434b-40b6-96f3-457d5f2bcc50 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:07.310309 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-069ea251-434b-40b6-96f3-457d5f2bcc50 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1722 microversion: 2.20 time: 0.476461 May 17 22:12:07.311238 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 241/490] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:06 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1722 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:07.315934 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-ee045664-0d16-4c61-9e69-a9d1c3b37385 req-4c32f42e-a429-4e02-ad15-9229499a4139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c568a7b-6b45-45c4-b60a-3514d7c43e6e", "name": "network-vif-unplugged", "status": "completed", "tag": "501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:07.324905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-ee045664-0d16-4c61-9e69-a9d1c3b37385 req-4c32f42e-a429-4e02-ad15-9229499a4139 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:07.325293 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-ee045664-0d16-4c61-9e69-a9d1c3b37385 req-4c32f42e-a429-4e02-ad15-9229499a4139 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:07.328707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1772f536-8fc3-4590-942c-51a756b263c5 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1547 microversion: 2.1 time: 0.471439 May 17 22:12:07.330055 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 250/491] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:06 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1547 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:07.339591 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-ee045664-0d16-4c61-9e69-a9d1c3b37385 req-4c32f42e-a429-4e02-ad15-9229499a4139 service nova] Creating event network-vif-unplugged:501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e for instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e on hv-cinder-83998 May 17 22:12:07.344979 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-ee045664-0d16-4c61-9e69-a9d1c3b37385 req-4c32f42e-a429-4e02-ad15-9229499a4139 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032356 May 17 22:12:07.345575 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 242/492] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:07.347307 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f9e87504-4b3f-4f89-9938-8b58deb3559e tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:07.348377 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f9e87504-4b3f-4f89-9938-8b58deb3559e tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:07.351514 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6f0766e9-7eaf-4a05-b942-58ec0b5ba35a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:07.355523 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6f0766e9-7eaf-4a05-b942-58ec0b5ba35a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:07.356259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6f0766e9-7eaf-4a05-b942-58ec0b5ba35a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Searching by: {'deleted': False, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5'} {{(pid=117594) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 17 22:12:07.356938 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9e87504-4b3f-4f89-9938-8b58deb3559e tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:07.357392 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9e87504-4b3f-4f89-9938-8b58deb3559e tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:07.358171 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9e87504-4b3f-4f89-9938-8b58deb3559e tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:07.358602 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9e87504-4b3f-4f89-9938-8b58deb3559e tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:07.362960 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f0766e9-7eaf-4a05-b942-58ec0b5ba35a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:07.363460 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f0766e9-7eaf-4a05-b942-58ec0b5ba35a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:07.364268 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f0766e9-7eaf-4a05-b942-58ec0b5ba35a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:07.364706 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f0766e9-7eaf-4a05-b942-58ec0b5ba35a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:07.455427 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.multi_cell_list [None req-6f0766e9-7eaf-4a05-b942-58ec0b5ba35a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 17 22:12:07.490282 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f9e87504-4b3f-4f89-9938-8b58deb3559e tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:07.498495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f9e87504-4b3f-4f89-9938-8b58deb3559e tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.167308 May 17 22:12:07.499094 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 251/493] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:07 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:07.563764 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6f0766e9-7eaf-4a05-b942-58ec0b5ba35a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.216807 May 17 22:12:07.564349 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 243/494] 10.222.0.24 () {58 vars in 1124 bytes} [Tue May 17 22:12:07 2022] GET /compute/v2.1/servers => generated 341 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:07.575445 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3971ba17-2942-4f86-8739-165e7d7fe2ac tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:07.575986 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3971ba17-2942-4f86-8739-165e7d7fe2ac tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:07.582255 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3971ba17-2942-4f86-8739-165e7d7fe2ac tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:07.582708 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3971ba17-2942-4f86-8739-165e7d7fe2ac tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:07.583499 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3971ba17-2942-4f86-8739-165e7d7fe2ac tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:07.583937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3971ba17-2942-4f86-8739-165e7d7fe2ac tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:07.716300 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3971ba17-2942-4f86-8739-165e7d7fe2ac tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:07.723501 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3971ba17-2942-4f86-8739-165e7d7fe2ac tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1547 microversion: 2.1 time: 0.152759 May 17 22:12:07.724056 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 252/495] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:07 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:08.329108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-949f4d32-da04-4d6f-a1fd-32a51d5c1af9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:08.329835 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-949f4d32-da04-4d6f-a1fd-32a51d5c1af9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:08.336228 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-949f4d32-da04-4d6f-a1fd-32a51d5c1af9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:08.336682 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-949f4d32-da04-4d6f-a1fd-32a51d5c1af9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:08.337453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-949f4d32-da04-4d6f-a1fd-32a51d5c1af9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:08.337892 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-949f4d32-da04-4d6f-a1fd-32a51d5c1af9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:08.474243 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-949f4d32-da04-4d6f-a1fd-32a51d5c1af9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:08.482234 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-949f4d32-da04-4d6f-a1fd-32a51d5c1af9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:08.483749 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-949f4d32-da04-4d6f-a1fd-32a51d5c1af9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:08.484876 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-949f4d32-da04-4d6f-a1fd-32a51d5c1af9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1722 microversion: 2.20 time: 0.159759 May 17 22:12:08.485434 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 244/496] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:08 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:08.515175 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2cf71326-73fe-4317-ad82-c013ff7187ba tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:08.517954 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2cf71326-73fe-4317-ad82-c013ff7187ba tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:08.522263 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cf71326-73fe-4317-ad82-c013ff7187ba tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:08.522856 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cf71326-73fe-4317-ad82-c013ff7187ba tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:08.523685 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cf71326-73fe-4317-ad82-c013ff7187ba tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:08.524313 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cf71326-73fe-4317-ad82-c013ff7187ba tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:08.658170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2cf71326-73fe-4317-ad82-c013ff7187ba tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:08.665753 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2cf71326-73fe-4317-ad82-c013ff7187ba tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.154837 May 17 22:12:08.666311 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 253/497] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:08 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:09.502271 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a6d9de23-aa46-44bd-a482-a333216488fa tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:09.502878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a6d9de23-aa46-44bd-a482-a333216488fa tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:09.509043 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6d9de23-aa46-44bd-a482-a333216488fa tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:09.509482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6d9de23-aa46-44bd-a482-a333216488fa tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:09.510234 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6d9de23-aa46-44bd-a482-a333216488fa tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:09.511391 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a6d9de23-aa46-44bd-a482-a333216488fa tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:09.639360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a6d9de23-aa46-44bd-a482-a333216488fa tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:09.647012 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a6d9de23-aa46-44bd-a482-a333216488fa tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:09.648525 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a6d9de23-aa46-44bd-a482-a333216488fa tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:09.649674 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a6d9de23-aa46-44bd-a482-a333216488fa tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1722 microversion: 2.20 time: 0.151172 May 17 22:12:09.650231 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 245/498] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:09 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:09.682828 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a3d08565-3c5f-4aee-9789-a6271d07b0aa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:09.683533 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a3d08565-3c5f-4aee-9789-a6271d07b0aa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:09.690060 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3d08565-3c5f-4aee-9789-a6271d07b0aa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:09.690521 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3d08565-3c5f-4aee-9789-a6271d07b0aa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:09.691328 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3d08565-3c5f-4aee-9789-a6271d07b0aa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:09.691769 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3d08565-3c5f-4aee-9789-a6271d07b0aa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:09.816908 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a3d08565-3c5f-4aee-9789-a6271d07b0aa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:09.825229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a3d08565-3c5f-4aee-9789-a6271d07b0aa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.145368 May 17 22:12:09.825229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 254/499] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:09 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:10.668431 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d1ebd0d3-d9e8-47aa-9db4-df01832956c9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:10.669073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d1ebd0d3-d9e8-47aa-9db4-df01832956c9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:10.675380 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1ebd0d3-d9e8-47aa-9db4-df01832956c9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:10.675827 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1ebd0d3-d9e8-47aa-9db4-df01832956c9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:10.676587 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1ebd0d3-d9e8-47aa-9db4-df01832956c9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:10.677018 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1ebd0d3-d9e8-47aa-9db4-df01832956c9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:10.800977 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d1ebd0d3-d9e8-47aa-9db4-df01832956c9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:10.808741 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d1ebd0d3-d9e8-47aa-9db4-df01832956c9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:10.810463 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d1ebd0d3-d9e8-47aa-9db4-df01832956c9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:10.811623 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d1ebd0d3-d9e8-47aa-9db4-df01832956c9 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1722 microversion: 2.20 time: 0.147304 May 17 22:12:10.812168 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 246/500] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:10 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:10.840808 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e9a98263-c6dd-4d99-90b2-70383417d421 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:10.841421 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e9a98263-c6dd-4d99-90b2-70383417d421 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:10.847767 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e9a98263-c6dd-4d99-90b2-70383417d421 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:10.848220 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e9a98263-c6dd-4d99-90b2-70383417d421 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:10.848992 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e9a98263-c6dd-4d99-90b2-70383417d421 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:10.849431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e9a98263-c6dd-4d99-90b2-70383417d421 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:10.982986 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e9a98263-c6dd-4d99-90b2-70383417d421 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:10.990522 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e9a98263-c6dd-4d99-90b2-70383417d421 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.153529 May 17 22:12:10.991092 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 255/501] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:10 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:11.712415 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a192a84d-4acc-4f8b-bda5-8d1b06757be2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4866bd78-7ea6-4d4b-84e3-d2b55d401ea5"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:11.713458 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a192a84d-4acc-4f8b-bda5-8d1b06757be2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:11.720792 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a192a84d-4acc-4f8b-bda5-8d1b06757be2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:11.721319 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a192a84d-4acc-4f8b-bda5-8d1b06757be2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:11.722074 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a192a84d-4acc-4f8b-bda5-8d1b06757be2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:11.722503 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a192a84d-4acc-4f8b-bda5-8d1b06757be2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:11.829349 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-13ff53ab-0181-42fb-adba-be09e1f791e6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:11.829951 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-13ff53ab-0181-42fb-adba-be09e1f791e6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:11.835733 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13ff53ab-0181-42fb-adba-be09e1f791e6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:11.836182 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13ff53ab-0181-42fb-adba-be09e1f791e6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:11.836944 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13ff53ab-0181-42fb-adba-be09e1f791e6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:11.837379 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-13ff53ab-0181-42fb-adba-be09e1f791e6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:11.973851 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-13ff53ab-0181-42fb-adba-be09e1f791e6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:11.982347 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-13ff53ab-0181-42fb-adba-be09e1f791e6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:11.983884 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-13ff53ab-0181-42fb-adba-be09e1f791e6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:11.985041 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-13ff53ab-0181-42fb-adba-be09e1f791e6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1722 microversion: 2.20 time: 0.159578 May 17 22:12:11.985599 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 256/502] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:11 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:12.006961 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-789ddd8a-a47e-4dec-9d12-127279282edb tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:12.007621 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-789ddd8a-a47e-4dec-9d12-127279282edb tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:12.014119 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-789ddd8a-a47e-4dec-9d12-127279282edb tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:12.014771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-789ddd8a-a47e-4dec-9d12-127279282edb tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:12.015576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-789ddd8a-a47e-4dec-9d12-127279282edb tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:12.016011 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-789ddd8a-a47e-4dec-9d12-127279282edb tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:12.151952 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-789ddd8a-a47e-4dec-9d12-127279282edb tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:12.159280 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-789ddd8a-a47e-4dec-9d12-127279282edb tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.155993 May 17 22:12:12.159867 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 257/503] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:12 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:13.003176 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bacafee2-3ce2-443f-8d14-006155dc80da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:13.003811 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bacafee2-3ce2-443f-8d14-006155dc80da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:13.009744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bacafee2-3ce2-443f-8d14-006155dc80da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:13.010195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bacafee2-3ce2-443f-8d14-006155dc80da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:13.011482 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bacafee2-3ce2-443f-8d14-006155dc80da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:13.011915 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bacafee2-3ce2-443f-8d14-006155dc80da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:13.137730 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bacafee2-3ce2-443f-8d14-006155dc80da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:13.145510 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bacafee2-3ce2-443f-8d14-006155dc80da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:13.146985 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bacafee2-3ce2-443f-8d14-006155dc80da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:13.148152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bacafee2-3ce2-443f-8d14-006155dc80da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1722 microversion: 2.20 time: 0.148940 May 17 22:12:13.148715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 258/504] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:12 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:13.176945 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8a54c932-5fa1-44bb-ae5d-667c9c7ce53b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:13.177547 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8a54c932-5fa1-44bb-ae5d-667c9c7ce53b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:13.184100 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8a54c932-5fa1-44bb-ae5d-667c9c7ce53b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:13.184550 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8a54c932-5fa1-44bb-ae5d-667c9c7ce53b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:13.185587 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8a54c932-5fa1-44bb-ae5d-667c9c7ce53b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:13.186038 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8a54c932-5fa1-44bb-ae5d-667c9c7ce53b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:13.312114 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8a54c932-5fa1-44bb-ae5d-667c9c7ce53b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:13.319788 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8a54c932-5fa1-44bb-ae5d-667c9c7ce53b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.146453 May 17 22:12:13.320351 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 259/505] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:13 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:14.166074 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-77c30be8-444c-483d-8f98-d69bf66542da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:14.166624 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-77c30be8-444c-483d-8f98-d69bf66542da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:14.173037 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77c30be8-444c-483d-8f98-d69bf66542da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:14.173479 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77c30be8-444c-483d-8f98-d69bf66542da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:14.174234 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77c30be8-444c-483d-8f98-d69bf66542da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:14.174661 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77c30be8-444c-483d-8f98-d69bf66542da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:14.308970 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-77c30be8-444c-483d-8f98-d69bf66542da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:14.316904 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-77c30be8-444c-483d-8f98-d69bf66542da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:14.318376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-77c30be8-444c-483d-8f98-d69bf66542da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:14.319558 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-77c30be8-444c-483d-8f98-d69bf66542da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1722 microversion: 2.20 time: 0.157401 May 17 22:12:14.320109 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 260/506] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:14 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:14.336230 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-77d75c08-92b9-422b-be39-b37a3f70dd3d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:14.336832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-77d75c08-92b9-422b-be39-b37a3f70dd3d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:14.342595 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77d75c08-92b9-422b-be39-b37a3f70dd3d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:14.343038 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77d75c08-92b9-422b-be39-b37a3f70dd3d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:14.343838 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77d75c08-92b9-422b-be39-b37a3f70dd3d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:14.344273 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-77d75c08-92b9-422b-be39-b37a3f70dd3d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:14.471227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-77d75c08-92b9-422b-be39-b37a3f70dd3d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:14.478455 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-77d75c08-92b9-422b-be39-b37a3f70dd3d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.145913 May 17 22:12:14.479011 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 261/507] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:14 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:15.342113 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f9809b67-7212-43cd-b4ae-78c629825426 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:15.342783 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f9809b67-7212-43cd-b4ae-78c629825426 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:15.349068 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9809b67-7212-43cd-b4ae-78c629825426 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:15.349763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9809b67-7212-43cd-b4ae-78c629825426 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:15.350525 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9809b67-7212-43cd-b4ae-78c629825426 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:15.350958 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9809b67-7212-43cd-b4ae-78c629825426 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:15.481096 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f9809b67-7212-43cd-b4ae-78c629825426 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:15.488781 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f9809b67-7212-43cd-b4ae-78c629825426 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:15.490290 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f9809b67-7212-43cd-b4ae-78c629825426 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:15.491474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f9809b67-7212-43cd-b4ae-78c629825426 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1722 microversion: 2.20 time: 0.154042 May 17 22:12:15.492031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 262/508] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:15 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:15.497029 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-285af725-f083-463d-b379-4a4a4c1289bc tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:15.497629 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-285af725-f083-463d-b379-4a4a4c1289bc tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:15.503185 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-285af725-f083-463d-b379-4a4a4c1289bc tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:15.503634 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-285af725-f083-463d-b379-4a4a4c1289bc tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:15.504407 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-285af725-f083-463d-b379-4a4a4c1289bc tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:15.504846 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-285af725-f083-463d-b379-4a4a4c1289bc tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:15.633381 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-285af725-f083-463d-b379-4a4a4c1289bc tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:15.648267 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-285af725-f083-463d-b379-4a4a4c1289bc tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.148459 May 17 22:12:15.648267 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 263/509] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:15 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:15.986636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-2a9c2027-b669-4095-8e1f-fc2f02ebf765 req-31f2e89d-df35-4673-8d80-00d3f9bb7b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a06c5d32-8f6a-42d0-8b91-540afe1db580", "name": "network-vif-plugged", "status": "completed", "tag": "e639faaf-c59e-4dcf-97ac-142d9f2351d2"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:15.994615 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-2a9c2027-b669-4095-8e1f-fc2f02ebf765 req-31f2e89d-df35-4673-8d80-00d3f9bb7b07 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:15.995060 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-2a9c2027-b669-4095-8e1f-fc2f02ebf765 req-31f2e89d-df35-4673-8d80-00d3f9bb7b07 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:16.007930 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-2a9c2027-b669-4095-8e1f-fc2f02ebf765 req-31f2e89d-df35-4673-8d80-00d3f9bb7b07 service nova] Creating event network-vif-plugged:e639faaf-c59e-4dcf-97ac-142d9f2351d2 for instance a06c5d32-8f6a-42d0-8b91-540afe1db580 on hv-cinder-83998 May 17 22:12:16.013793 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-2a9c2027-b669-4095-8e1f-fc2f02ebf765 req-31f2e89d-df35-4673-8d80-00d3f9bb7b07 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030654 May 17 22:12:16.014456 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 264/510] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:16.379541 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a192a84d-4acc-4f8b-bda5-8d1b06757be2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "POST /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.670647 May 17 22:12:16.380184 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 247/511] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:12:11 2022] POST /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments => generated 194 bytes in 4672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:16.510508 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-52f5b6f2-1e4d-40ff-b76a-9c9561023c23 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:16.511287 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-52f5b6f2-1e4d-40ff-b76a-9c9561023c23 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:16.517377 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52f5b6f2-1e4d-40ff-b76a-9c9561023c23 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:16.517784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52f5b6f2-1e4d-40ff-b76a-9c9561023c23 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:16.518549 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52f5b6f2-1e4d-40ff-b76a-9c9561023c23 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:16.518983 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52f5b6f2-1e4d-40ff-b76a-9c9561023c23 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:16.664927 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-36ed5fa9-33e5-4673-b206-20da98164c34 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:16.665852 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-36ed5fa9-33e5-4673-b206-20da98164c34 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:16.674028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36ed5fa9-33e5-4673-b206-20da98164c34 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:16.674863 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36ed5fa9-33e5-4673-b206-20da98164c34 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:16.675877 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36ed5fa9-33e5-4673-b206-20da98164c34 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:16.676763 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-36ed5fa9-33e5-4673-b206-20da98164c34 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:16.751772 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-52f5b6f2-1e4d-40ff-b76a-9c9561023c23 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:16.764663 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-52f5b6f2-1e4d-40ff-b76a-9c9561023c23 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:16.764663 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-52f5b6f2-1e4d-40ff-b76a-9c9561023c23 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:16.764889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-52f5b6f2-1e4d-40ff-b76a-9c9561023c23 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1725 microversion: 2.20 time: 0.259073 May 17 22:12:16.765635 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 265/512] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:16 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:16.783224 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0f0bccf3-c723-4c7f-a1c0-c6aff3ad2a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfe64674-52ce-4e92-ae5a-a0b8b0e82818"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:16.784313 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0f0bccf3-c723-4c7f-a1c0-c6aff3ad2a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:16.790131 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0f0bccf3-c723-4c7f-a1c0-c6aff3ad2a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:16.797691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0f0bccf3-c723-4c7f-a1c0-c6aff3ad2a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:16.797691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0f0bccf3-c723-4c7f-a1c0-c6aff3ad2a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:16.797691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0f0bccf3-c723-4c7f-a1c0-c6aff3ad2a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:16.826554 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-36ed5fa9-33e5-4673-b206-20da98164c34 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:16.833893 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-36ed5fa9-33e5-4673-b206-20da98164c34 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.174011 May 17 22:12:16.834494 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 248/513] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:16 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:17.811858 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0f0bccf3-c723-4c7f-a1c0-c6aff3ad2a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "POST /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.032582 May 17 22:12:17.812369 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 266/514] 10.222.0.24 () {62 vars in 1363 bytes} [Tue May 17 22:12:16 2022] POST /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-volume_attachments => generated 188 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 22:12:17.851423 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-97723706-aa0f-484a-bdb2-1cf52255a41d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:17.852122 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-97723706-aa0f-484a-bdb2-1cf52255a41d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:17.860891 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-97723706-aa0f-484a-bdb2-1cf52255a41d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:17.861341 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-97723706-aa0f-484a-bdb2-1cf52255a41d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:17.862110 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-97723706-aa0f-484a-bdb2-1cf52255a41d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:17.864906 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-97723706-aa0f-484a-bdb2-1cf52255a41d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:17.931434 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1fb2b31c-8532-4815-9ffd-3c78b8019964 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:17.932005 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1fb2b31c-8532-4815-9ffd-3c78b8019964 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:17.947546 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1fb2b31c-8532-4815-9ffd-3c78b8019964 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:17.948109 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1fb2b31c-8532-4815-9ffd-3c78b8019964 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:17.949032 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1fb2b31c-8532-4815-9ffd-3c78b8019964 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:17.950301 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1fb2b31c-8532-4815-9ffd-3c78b8019964 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:18.006483 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-97723706-aa0f-484a-bdb2-1cf52255a41d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:18.013729 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-97723706-aa0f-484a-bdb2-1cf52255a41d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.166493 May 17 22:12:18.014301 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 249/515] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:17 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:18.164062 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1fb2b31c-8532-4815-9ffd-3c78b8019964 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "POST /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/action" status: 202 len: 0 microversion: 2.20 time: 0.236384 May 17 22:12:18.164683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 267/516] 10.222.0.24 () {62 vars in 1318 bytes} [Tue May 17 22:12:17 2022] POST /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 17 22:12:18.176199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f435f4a5-6f02-48a7-8e43-7e39f616b4f7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:18.176453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f435f4a5-6f02-48a7-8e43-7e39f616b4f7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:18.182228 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f435f4a5-6f02-48a7-8e43-7e39f616b4f7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:18.182874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f435f4a5-6f02-48a7-8e43-7e39f616b4f7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:18.184349 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f435f4a5-6f02-48a7-8e43-7e39f616b4f7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:18.185049 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f435f4a5-6f02-48a7-8e43-7e39f616b4f7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:18.323143 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f435f4a5-6f02-48a7-8e43-7e39f616b4f7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:18.331556 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f435f4a5-6f02-48a7-8e43-7e39f616b4f7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:18.333169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f435f4a5-6f02-48a7-8e43-7e39f616b4f7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:18.334393 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f435f4a5-6f02-48a7-8e43-7e39f616b4f7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1751 microversion: 2.20 time: 0.163212 May 17 22:12:18.335274 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 250/517] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:18 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:19.032625 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-676e404b-ac1c-4c69-b86b-b0220db309af tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:19.033738 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-676e404b-ac1c-4c69-b86b-b0220db309af tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:19.041416 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-676e404b-ac1c-4c69-b86b-b0220db309af tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:19.041813 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-676e404b-ac1c-4c69-b86b-b0220db309af tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:19.042601 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-676e404b-ac1c-4c69-b86b-b0220db309af tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:19.043059 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-676e404b-ac1c-4c69-b86b-b0220db309af tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:19.177422 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-676e404b-ac1c-4c69-b86b-b0220db309af tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:19.185116 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-676e404b-ac1c-4c69-b86b-b0220db309af tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.158229 May 17 22:12:19.185755 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 268/518] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:19 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:19.354894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-588478ad-a4d2-472f-b4cf-c6b73054f512 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:19.355675 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-588478ad-a4d2-472f-b4cf-c6b73054f512 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:19.363596 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-588478ad-a4d2-472f-b4cf-c6b73054f512 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:19.364364 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-588478ad-a4d2-472f-b4cf-c6b73054f512 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:19.365711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-588478ad-a4d2-472f-b4cf-c6b73054f512 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:19.366588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-588478ad-a4d2-472f-b4cf-c6b73054f512 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:19.508796 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-588478ad-a4d2-472f-b4cf-c6b73054f512 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:19.517834 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-588478ad-a4d2-472f-b4cf-c6b73054f512 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:19.519338 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-588478ad-a4d2-472f-b4cf-c6b73054f512 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:19.520570 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-588478ad-a4d2-472f-b4cf-c6b73054f512 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1751 microversion: 2.20 time: 0.169601 May 17 22:12:19.521128 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 251/519] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:19 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:20.202368 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a41f1426-6bee-4fa5-981f-e672b5c096e6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:20.202908 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a41f1426-6bee-4fa5-981f-e672b5c096e6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:20.209234 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a41f1426-6bee-4fa5-981f-e672b5c096e6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:20.209678 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a41f1426-6bee-4fa5-981f-e672b5c096e6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:20.210441 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a41f1426-6bee-4fa5-981f-e672b5c096e6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:20.210874 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a41f1426-6bee-4fa5-981f-e672b5c096e6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:20.348577 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a41f1426-6bee-4fa5-981f-e672b5c096e6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:20.357306 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a41f1426-6bee-4fa5-981f-e672b5c096e6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1314 microversion: 2.1 time: 0.159361 May 17 22:12:20.357894 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 269/520] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:20 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:20.539618 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7d21f0e1-df06-4d62-a0a7-04727637a6ed tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:20.540295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7d21f0e1-df06-4d62-a0a7-04727637a6ed tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:20.546701 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d21f0e1-df06-4d62-a0a7-04727637a6ed tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:20.547176 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d21f0e1-df06-4d62-a0a7-04727637a6ed tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:20.547938 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d21f0e1-df06-4d62-a0a7-04727637a6ed tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:20.548371 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d21f0e1-df06-4d62-a0a7-04727637a6ed tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:20.681009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7d21f0e1-df06-4d62-a0a7-04727637a6ed tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:20.691840 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7d21f0e1-df06-4d62-a0a7-04727637a6ed tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:20.693665 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7d21f0e1-df06-4d62-a0a7-04727637a6ed tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:20.694784 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7d21f0e1-df06-4d62-a0a7-04727637a6ed tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1751 microversion: 2.20 time: 0.159027 May 17 22:12:20.695360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 252/521] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:20 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:21.374825 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e58fe9ae-30a6-411d-9e78-32d1c4358aa5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:21.375625 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e58fe9ae-30a6-411d-9e78-32d1c4358aa5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:21.382608 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e58fe9ae-30a6-411d-9e78-32d1c4358aa5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:21.383053 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e58fe9ae-30a6-411d-9e78-32d1c4358aa5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:21.384312 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e58fe9ae-30a6-411d-9e78-32d1c4358aa5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:21.385489 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e58fe9ae-30a6-411d-9e78-32d1c4358aa5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:21.516677 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e58fe9ae-30a6-411d-9e78-32d1c4358aa5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:21.524697 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e58fe9ae-30a6-411d-9e78-32d1c4358aa5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1499 microversion: 2.1 time: 0.154645 May 17 22:12:21.525265 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 270/522] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:21 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:21.713710 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5c9b632b-27a9-4cb2-a656-79739b1ea05d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:21.714250 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5c9b632b-27a9-4cb2-a656-79739b1ea05d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:21.721242 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c9b632b-27a9-4cb2-a656-79739b1ea05d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:21.721685 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c9b632b-27a9-4cb2-a656-79739b1ea05d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:21.722450 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c9b632b-27a9-4cb2-a656-79739b1ea05d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:21.722886 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5c9b632b-27a9-4cb2-a656-79739b1ea05d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:21.854739 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5c9b632b-27a9-4cb2-a656-79739b1ea05d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:21.863274 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5c9b632b-27a9-4cb2-a656-79739b1ea05d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:21.864756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5c9b632b-27a9-4cb2-a656-79739b1ea05d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:21.866191 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5c9b632b-27a9-4cb2-a656-79739b1ea05d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1753 microversion: 2.20 time: 0.156108 May 17 22:12:21.866448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 253/523] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:21 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:22.531981 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7b6e0d3b-4938-4c99-895a-c7596d592cb5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:22.532540 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7b6e0d3b-4938-4c99-895a-c7596d592cb5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:22.538896 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7b6e0d3b-4938-4c99-895a-c7596d592cb5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:22.540873 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7b6e0d3b-4938-4c99-895a-c7596d592cb5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:22.540873 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7b6e0d3b-4938-4c99-895a-c7596d592cb5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:22.540873 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7b6e0d3b-4938-4c99-895a-c7596d592cb5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:22.566217 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7b6e0d3b-4938-4c99-895a-c7596d592cb5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:12:22.863918 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7b6e0d3b-4938-4c99-895a-c7596d592cb5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 204 len: 0 microversion: 2.1 time: 0.335423 May 17 22:12:22.864533 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 271/524] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:12:22 2022] DELETE /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:12:22.872637 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-34243d6f-687d-4199-9714-a66846115214 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:22.873266 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-34243d6f-687d-4199-9714-a66846115214 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:22.879765 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34243d6f-687d-4199-9714-a66846115214 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:22.885395 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34243d6f-687d-4199-9714-a66846115214 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:22.885395 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34243d6f-687d-4199-9714-a66846115214 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:22.885395 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34243d6f-687d-4199-9714-a66846115214 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:22.885877 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-443f2ef9-1468-43bc-b60d-d17334fcbf61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:22.885877 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-443f2ef9-1468-43bc-b60d-d17334fcbf61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:22.891956 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-443f2ef9-1468-43bc-b60d-d17334fcbf61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:22.892635 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-443f2ef9-1468-43bc-b60d-d17334fcbf61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:22.893586 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-443f2ef9-1468-43bc-b60d-d17334fcbf61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:22.894213 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-443f2ef9-1468-43bc-b60d-d17334fcbf61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:23.074257 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-34243d6f-687d-4199-9714-a66846115214 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:23.081684 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-34243d6f-687d-4199-9714-a66846115214 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1505 microversion: 2.1 time: 0.212904 May 17 22:12:23.082624 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 254/525] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:22 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:23.085098 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-443f2ef9-1468-43bc-b60d-d17334fcbf61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:23.093914 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-443f2ef9-1468-43bc-b60d-d17334fcbf61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:23.095443 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-443f2ef9-1468-43bc-b60d-d17334fcbf61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:23.096597 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-443f2ef9-1468-43bc-b60d-d17334fcbf61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1753 microversion: 2.20 time: 0.215678 May 17 22:12:23.097155 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 272/526] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:22 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1753 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:24.099527 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-82a4b60d-cc49-4241-adfb-36d2a6dbcffa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:24.100154 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-82a4b60d-cc49-4241-adfb-36d2a6dbcffa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:24.115471 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-82a4b60d-cc49-4241-adfb-36d2a6dbcffa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:24.115955 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-82a4b60d-cc49-4241-adfb-36d2a6dbcffa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:24.116814 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-82a4b60d-cc49-4241-adfb-36d2a6dbcffa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:24.117257 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-82a4b60d-cc49-4241-adfb-36d2a6dbcffa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:24.120928 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f9601c40-1fef-4897-90f7-2702a6a6c0c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:24.122809 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f9601c40-1fef-4897-90f7-2702a6a6c0c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:24.129244 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9601c40-1fef-4897-90f7-2702a6a6c0c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:24.129686 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9601c40-1fef-4897-90f7-2702a6a6c0c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:24.130449 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9601c40-1fef-4897-90f7-2702a6a6c0c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:24.130876 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f9601c40-1fef-4897-90f7-2702a6a6c0c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:24.309139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-82a4b60d-cc49-4241-adfb-36d2a6dbcffa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:24.316674 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-82a4b60d-cc49-4241-adfb-36d2a6dbcffa tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1505 microversion: 2.1 time: 0.220939 May 17 22:12:24.317252 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 255/527] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:24 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:24.320661 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f9601c40-1fef-4897-90f7-2702a6a6c0c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:24.329651 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f9601c40-1fef-4897-90f7-2702a6a6c0c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:24.331243 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f9601c40-1fef-4897-90f7-2702a6a6c0c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:24.332402 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f9601c40-1fef-4897-90f7-2702a6a6c0c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1753 microversion: 2.20 time: 0.215374 May 17 22:12:24.332959 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 273/528] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:24 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1753 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:24.533850 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d7b94909-9acf-4766-9f85-8bbd409aae5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:24.534354 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d7b94909-9acf-4766-9f85-8bbd409aae5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:24.540175 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d7b94909-9acf-4766-9f85-8bbd409aae5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:24.540623 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d7b94909-9acf-4766-9f85-8bbd409aae5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:24.541385 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d7b94909-9acf-4766-9f85-8bbd409aae5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:24.541819 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d7b94909-9acf-4766-9f85-8bbd409aae5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:24.664299 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-d7b94909-9acf-4766-9f85-8bbd409aae5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lazy-loading 'services' on Instance uuid 8865edd3-610c-4338-ae57-746c5b24b8cc {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:12:24.868541 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d7b94909-9acf-4766-9f85-8bbd409aae5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc/os-volume_attachments/aa5c11a8-01ab-48a6-b4a4-a8c8fdca9011" status: 202 len: 0 microversion: 2.1 time: 0.338291 May 17 22:12:24.874076 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 256/529] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 17 22:12:24 2022] DELETE /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc/os-volume_attachments/aa5c11a8-01ab-48a6-b4a4-a8c8fdca9011 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:12:25.332917 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-21324325-1310-46e3-93b0-26227798c544 req-92ad80a4-777d-48c8-8c39-a9f678fb584a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a06c5d32-8f6a-42d0-8b91-540afe1db580", "name": "network-vif-deleted", "tag": "e639faaf-c59e-4dcf-97ac-142d9f2351d2"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:25.335227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-53914610-ace3-4ab4-837b-a05e228faff2 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:25.336534 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-53914610-ace3-4ab4-837b-a05e228faff2 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:25.341726 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-21324325-1310-46e3-93b0-26227798c544 req-92ad80a4-777d-48c8-8c39-a9f678fb584a service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:25.346287 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-21324325-1310-46e3-93b0-26227798c544 req-92ad80a4-777d-48c8-8c39-a9f678fb584a service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:25.346417 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53914610-ace3-4ab4-837b-a05e228faff2 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:25.346417 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53914610-ace3-4ab4-837b-a05e228faff2 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:25.346417 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53914610-ace3-4ab4-837b-a05e228faff2 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:25.346417 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53914610-ace3-4ab4-837b-a05e228faff2 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:25.355461 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-21324325-1310-46e3-93b0-26227798c544 req-92ad80a4-777d-48c8-8c39-a9f678fb584a service nova] Creating event network-vif-deleted:e639faaf-c59e-4dcf-97ac-142d9f2351d2 for instance a06c5d32-8f6a-42d0-8b91-540afe1db580 on hv-cinder-83998 May 17 22:12:25.360550 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-21324325-1310-46e3-93b0-26227798c544 req-92ad80a4-777d-48c8-8c39-a9f678fb584a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031172 May 17 22:12:25.361228 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 274/530] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:25.366794 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7393788f-fb91-4b52-aa93-45df1a980624 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:25.367976 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7393788f-fb91-4b52-aa93-45df1a980624 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:25.374192 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7393788f-fb91-4b52-aa93-45df1a980624 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:25.380646 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7393788f-fb91-4b52-aa93-45df1a980624 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:25.380646 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7393788f-fb91-4b52-aa93-45df1a980624 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:25.380646 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7393788f-fb91-4b52-aa93-45df1a980624 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:25.413425 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-53914610-ace3-4ab4-837b-a05e228faff2 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:25.419939 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-53914610-ace3-4ab4-837b-a05e228faff2 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 200 len: 1463 microversion: 2.1 time: 0.088732 May 17 22:12:25.420515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 257/531] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:25 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 1463 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:25.515837 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7393788f-fb91-4b52-aa93-45df1a980624 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:25.524284 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7393788f-fb91-4b52-aa93-45df1a980624 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:25.525750 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7393788f-fb91-4b52-aa93-45df1a980624 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:25.526924 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7393788f-fb91-4b52-aa93-45df1a980624 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1753 microversion: 2.20 time: 0.164534 May 17 22:12:25.527828 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 275/532] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:25 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:26.437042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1815be68-b7ae-4597-97cf-b7bb174313c6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:26.437713 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1815be68-b7ae-4597-97cf-b7bb174313c6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: a06c5d32-8f6a-42d0-8b91-540afe1db580] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:26.444276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1815be68-b7ae-4597-97cf-b7bb174313c6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:26.444751 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1815be68-b7ae-4597-97cf-b7bb174313c6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:26.445562 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1815be68-b7ae-4597-97cf-b7bb174313c6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:26.446012 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1815be68-b7ae-4597-97cf-b7bb174313c6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:26.459758 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-1815be68-b7ae-4597-97cf-b7bb174313c6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] HTTP exception thrown: Instance a06c5d32-8f6a-42d0-8b91-540afe1db580 could not be found. May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1815be68-b7ae-4597-97cf-b7bb174313c6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Request method failure captured: May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 HTTP/1.1 May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB2p5dkNt1T4RKRBMyhtNVnM-J8PE07kt_vYJ5UChBVKwPhfw-hMhYmxpGf2oj_s9yA63TAD2RoE4SQ9p60316IWYodhcuKlkR8iBqvdTa5cw5LFZkqK-z9KNUmgSQtxTXDjHl-vWJqktoHYIakcNZDLn1-K2BEe8EncB8cqlNcAe38 May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 8cb417f91c56432a9f7d9ef7bcf528f9 May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-VolumesActionsTest-1081635847 May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:12:26.465297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:12:26.467071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8cb417f91c56432a9f7d9ef7bcf528f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8cb417f91c56432a9f7d9ef7bcf528f9", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8cb417f91c56432a9f7d9ef7bcf528f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8cb417f91c56432a9f7d9ef7bcf528f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:12:26.467071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-VolumesActionsTest-1081635847 May 17 22:12:26.467071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 8cb417f91c56432a9f7d9ef7bcf528f9 May 17 22:12:26.467071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-VolumesActionsTest-1081635847 May 17 22:12:26.467071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-VolumesActionsTest-1081635847-project May 17 22:12:26.467071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:12:26.467071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:12:26.467071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 091ee1085f2648649053108559390cd1 May 17 22:12:26.467071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-VolumesActionsTest-1081635847-project May 17 22:12:26.467071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:12:26.467071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance a06c5d32-8f6a-42d0-8b91-540afe1db580 could not be found. May 17 22:12:26.467071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': 'a06c5d32-8f6a-42d0-8b91-540afe1db580'} May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a06c5d32-8f6a-42d0-8b91-540afe1db580 could not be found. May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:12:26.468053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a06c5d32-8f6a-42d0-8b91-540afe1db580 could not be found. May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a06c5d32-8f6a-42d0-8b91-540afe1db580 could not be found. May 17 22:12:26.469561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:12:26.470878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1815be68-b7ae-4597-97cf-b7bb174313c6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Returning 404 to user: Instance a06c5d32-8f6a-42d0-8b91-540afe1db580 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:12:26.470878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1815be68-b7ae-4597-97cf-b7bb174313c6 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580" status: 404 len: 111 microversion: 2.1 time: 0.030159 May 17 22:12:26.470878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 258/533] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:26 2022] GET /compute/v2.1/servers/a06c5d32-8f6a-42d0-8b91-540afe1db580 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:12:26.512919 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1397875792", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "networks": [{"uuid": "ef31749b-f5c4-461d-bb8a-dab8658195c0"}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:26.562711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4c553f69-418e-4595-be33-c010fa06b568 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:26.563347 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4c553f69-418e-4595-be33-c010fa06b568 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:26.571956 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] validate_networks() for [('ef31749b-f5c4-461d-bb8a-dab8658195c0', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:12:26.572270 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c553f69-418e-4595-be33-c010fa06b568 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:26.572270 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c553f69-418e-4595-be33-c010fa06b568 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:26.572270 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c553f69-418e-4595-be33-c010fa06b568 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:26.572270 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c553f69-418e-4595-be33-c010fa06b568 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:26.771897 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4c553f69-418e-4595-be33-c010fa06b568 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:26.780652 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4c553f69-418e-4595-be33-c010fa06b568 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:26.782128 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4c553f69-418e-4595-be33-c010fa06b568 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:26.783325 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4c553f69-418e-4595-be33-c010fa06b568 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1753 microversion: 2.20 time: 0.224971 May 17 22:12:26.783880 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 259/534] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:26 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1753 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:26.969899 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:12:26.970321 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:12:26.970855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:12:26.971296 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:12:26.971707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:12:26.980329 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:26.980768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:26.981563 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:26.981994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:26.998191 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Getting quotas for project 8cb417f91c56432a9f7d9ef7bcf528f9. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:12:27.003427 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Getting quotas for user 091ee1085f2648649053108559390cd1 and project 8cb417f91c56432a9f7d9ef7bcf528f9. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:12:27.015371 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:12:27.017787 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:12:27.136817 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a98ba1b1-7b1c-4901-a5f1-e9d273f1ed01 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627857 May 17 22:12:27.137483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 276/535] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:12:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:12:27.147636 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3f81b28f-8f4f-4ad8-a5a3-cd795c408650 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:27.148241 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3f81b28f-8f4f-4ad8-a5a3-cd795c408650 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:27.199478 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3f81b28f-8f4f-4ad8-a5a3-cd795c408650 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:27.205955 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3f81b28f-8f4f-4ad8-a5a3-cd795c408650 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1214 microversion: 2.1 time: 0.062340 May 17 22:12:27.206740 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 260/536] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:27 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:27.802327 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-07cbac6c-15cd-4782-9215-8263753af425 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:27.802924 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-07cbac6c-15cd-4782-9215-8263753af425 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:27.809622 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-07cbac6c-15cd-4782-9215-8263753af425 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:27.810592 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-07cbac6c-15cd-4782-9215-8263753af425 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:27.811393 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-07cbac6c-15cd-4782-9215-8263753af425 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:27.811830 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-07cbac6c-15cd-4782-9215-8263753af425 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:27.955565 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-07cbac6c-15cd-4782-9215-8263753af425 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:27.963968 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-07cbac6c-15cd-4782-9215-8263753af425 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:27.965456 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-07cbac6c-15cd-4782-9215-8263753af425 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:27.966609 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-07cbac6c-15cd-4782-9215-8263753af425 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1753 microversion: 2.20 time: 0.168666 May 17 22:12:27.967872 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 277/537] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:27 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:28.162881 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-510f4d49-078d-4012-89d1-89cb6af06e32 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:28.163521 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-510f4d49-078d-4012-89d1-89cb6af06e32 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:28.170100 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-510f4d49-078d-4012-89d1-89cb6af06e32 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:28.170509 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-510f4d49-078d-4012-89d1-89cb6af06e32 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:28.171308 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-510f4d49-078d-4012-89d1-89cb6af06e32 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:28.171775 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-510f4d49-078d-4012-89d1-89cb6af06e32 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:28.223327 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-59c192c2-f546-4923-8a62-180f0a713396 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:28.223844 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-59c192c2-f546-4923-8a62-180f0a713396 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:28.229718 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59c192c2-f546-4923-8a62-180f0a713396 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:28.234565 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59c192c2-f546-4923-8a62-180f0a713396 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:28.234565 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59c192c2-f546-4923-8a62-180f0a713396 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:28.234565 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59c192c2-f546-4923-8a62-180f0a713396 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:28.303206 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-59c192c2-f546-4923-8a62-180f0a713396 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:28.311525 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-59c192c2-f546-4923-8a62-180f0a713396 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1218 microversion: 2.1 time: 0.092154 May 17 22:12:28.312105 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 278/538] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:28 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:28.327874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-510f4d49-078d-4012-89d1-89cb6af06e32 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:28.335564 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-510f4d49-078d-4012-89d1-89cb6af06e32 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1593 microversion: 2.1 time: 0.176679 May 17 22:12:28.336127 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 261/539] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:28 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1593 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:28.985300 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-677f62e6-7ec5-49c1-8464-574e29ede318 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:28.986095 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-677f62e6-7ec5-49c1-8464-574e29ede318 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:28.992957 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-677f62e6-7ec5-49c1-8464-574e29ede318 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:28.999923 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-677f62e6-7ec5-49c1-8464-574e29ede318 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:28.999923 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-677f62e6-7ec5-49c1-8464-574e29ede318 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:28.999923 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-677f62e6-7ec5-49c1-8464-574e29ede318 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:29.213278 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-677f62e6-7ec5-49c1-8464-574e29ede318 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:29.224555 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-677f62e6-7ec5-49c1-8464-574e29ede318 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:29.226960 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-677f62e6-7ec5-49c1-8464-574e29ede318 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:29.229498 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-677f62e6-7ec5-49c1-8464-574e29ede318 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1753 microversion: 2.20 time: 0.248548 May 17 22:12:29.238104 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 279/540] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:28 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1753 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:29.328736 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5a2d7723-a634-4a0e-8ee5-bfbdb1644629 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:29.329276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5a2d7723-a634-4a0e-8ee5-bfbdb1644629 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:29.335683 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5a2d7723-a634-4a0e-8ee5-bfbdb1644629 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:29.336131 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5a2d7723-a634-4a0e-8ee5-bfbdb1644629 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:29.336892 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5a2d7723-a634-4a0e-8ee5-bfbdb1644629 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:29.337329 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5a2d7723-a634-4a0e-8ee5-bfbdb1644629 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:29.401936 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5a2d7723-a634-4a0e-8ee5-bfbdb1644629 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:29.409946 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5a2d7723-a634-4a0e-8ee5-bfbdb1644629 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1284 microversion: 2.1 time: 0.085790 May 17 22:12:29.410519 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 262/541] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:29 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:30.248342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-90bbe0c1-e6f6-4448-b970-f64a6b3d63e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:30.249487 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-90bbe0c1-e6f6-4448-b970-f64a6b3d63e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:30.257155 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90bbe0c1-e6f6-4448-b970-f64a6b3d63e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:30.257602 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90bbe0c1-e6f6-4448-b970-f64a6b3d63e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:30.258373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90bbe0c1-e6f6-4448-b970-f64a6b3d63e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:30.258796 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-90bbe0c1-e6f6-4448-b970-f64a6b3d63e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:30.426866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-90bbe0c1-e6f6-4448-b970-f64a6b3d63e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:30.427039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1ae0e0bf-ea15-49a7-a1b7-5c8723e12444 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:30.428023 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1ae0e0bf-ea15-49a7-a1b7-5c8723e12444 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:30.435749 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1ae0e0bf-ea15-49a7-a1b7-5c8723e12444 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:30.436193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1ae0e0bf-ea15-49a7-a1b7-5c8723e12444 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:30.436789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-90bbe0c1-e6f6-4448-b970-f64a6b3d63e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:30.436961 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1ae0e0bf-ea15-49a7-a1b7-5c8723e12444 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:30.437573 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1ae0e0bf-ea15-49a7-a1b7-5c8723e12444 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:30.438649 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-90bbe0c1-e6f6-4448-b970-f64a6b3d63e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:30.440081 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-90bbe0c1-e6f6-4448-b970-f64a6b3d63e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.195817 May 17 22:12:30.440825 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 280/542] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:30 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:30.593047 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-3ce32f44-e23d-4782-898a-2b00eaedc2f8 req-2c2715b4-7813-4727-ac52-2e207e3fc493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c468659-e42a-4284-9a0c-39aa262bd9a5", "tag": "6b82dab7-02cb-4cc1-a078-91095811826f"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:30.602526 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-3ce32f44-e23d-4782-898a-2b00eaedc2f8 req-2c2715b4-7813-4727-ac52-2e207e3fc493 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:30.603085 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-3ce32f44-e23d-4782-898a-2b00eaedc2f8 req-2c2715b4-7813-4727-ac52-2e207e3fc493 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:30.617300 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-3ce32f44-e23d-4782-898a-2b00eaedc2f8 req-2c2715b4-7813-4727-ac52-2e207e3fc493 service nova] Creating event network-changed:6b82dab7-02cb-4cc1-a078-91095811826f for instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 on hv-cinder-83998 May 17 22:12:30.624635 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-3ce32f44-e23d-4782-898a-2b00eaedc2f8 req-2c2715b4-7813-4727-ac52-2e207e3fc493 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035223 May 17 22:12:30.626459 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 281/543] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:12:30.733380 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1ae0e0bf-ea15-49a7-a1b7-5c8723e12444 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:30.741104 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1ae0e0bf-ea15-49a7-a1b7-5c8723e12444 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.318467 May 17 22:12:30.742283 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 263/544] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:30 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:31.315308 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9d2e227b-fcf0-45e8-a8e3-398427996630 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:31.316698 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9d2e227b-fcf0-45e8-a8e3-398427996630 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:31.341803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d2e227b-fcf0-45e8-a8e3-398427996630 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:31.342555 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d2e227b-fcf0-45e8-a8e3-398427996630 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:31.343551 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d2e227b-fcf0-45e8-a8e3-398427996630 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:31.344441 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d2e227b-fcf0-45e8-a8e3-398427996630 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:31.374370 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9d2e227b-fcf0-45e8-a8e3-398427996630 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:12:31.465861 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f886e14f-6433-4492-abbb-6c8d7cc77353 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:31.467437 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f886e14f-6433-4492-abbb-6c8d7cc77353 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:31.475613 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f886e14f-6433-4492-abbb-6c8d7cc77353 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:31.476385 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f886e14f-6433-4492-abbb-6c8d7cc77353 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:31.481133 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f886e14f-6433-4492-abbb-6c8d7cc77353 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:31.481133 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f886e14f-6433-4492-abbb-6c8d7cc77353 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:31.714715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9d2e227b-fcf0-45e8-a8e3-398427996630 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 204 len: 0 microversion: 2.1 time: 0.403029 May 17 22:12:31.720582 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 282/545] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:12:31 2022] DELETE /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:12:31.726395 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3f3e0032-14bd-4337-aa69-1de28f17a7ec tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:31.727235 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3f3e0032-14bd-4337-aa69-1de28f17a7ec tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:31.735037 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3f3e0032-14bd-4337-aa69-1de28f17a7ec tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:31.735603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3f3e0032-14bd-4337-aa69-1de28f17a7ec tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:31.736482 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3f3e0032-14bd-4337-aa69-1de28f17a7ec tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:31.737582 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3f3e0032-14bd-4337-aa69-1de28f17a7ec tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:31.856595 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f886e14f-6433-4492-abbb-6c8d7cc77353 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:31.867224 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f886e14f-6433-4492-abbb-6c8d7cc77353 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:31.869075 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f886e14f-6433-4492-abbb-6c8d7cc77353 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:31.870895 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f886e14f-6433-4492-abbb-6c8d7cc77353 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.414603 May 17 22:12:31.872502 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 264/546] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:31 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:31.878323 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5fa55093-b258-4774-96b0-e215e51fa697 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:31.879077 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5fa55093-b258-4774-96b0-e215e51fa697 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:31.896682 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5fa55093-b258-4774-96b0-e215e51fa697 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:31.897142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5fa55093-b258-4774-96b0-e215e51fa697 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:31.897959 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5fa55093-b258-4774-96b0-e215e51fa697 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:31.898746 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5fa55093-b258-4774-96b0-e215e51fa697 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:32.027574 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3f3e0032-14bd-4337-aa69-1de28f17a7ec tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:32.035701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3f3e0032-14bd-4337-aa69-1de28f17a7ec tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1512 microversion: 2.1 time: 0.312894 May 17 22:12:32.035701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 283/547] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:31 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:32.122289 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5fa55093-b258-4774-96b0-e215e51fa697 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:32.129911 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5fa55093-b258-4774-96b0-e215e51fa697 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.256251 May 17 22:12:32.130484 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 265/548] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:31 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:32.288237 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-8aede205-f1e5-4a03-9af7-7863f223b7b1 req-0e9ad8cc-e882-4f14-a7b5-19ba4c2b1dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf0a9fb-ace7-4487-9453-fa095718cfc8", "tag": "b67e5a8d-71dd-4b27-94cf-bf13726c9536"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:32.297182 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-8aede205-f1e5-4a03-9af7-7863f223b7b1 req-0e9ad8cc-e882-4f14-a7b5-19ba4c2b1dfe service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:32.297874 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-8aede205-f1e5-4a03-9af7-7863f223b7b1 req-0e9ad8cc-e882-4f14-a7b5-19ba4c2b1dfe service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:32.310360 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-8aede205-f1e5-4a03-9af7-7863f223b7b1 req-0e9ad8cc-e882-4f14-a7b5-19ba4c2b1dfe service nova] Creating event network-changed:b67e5a8d-71dd-4b27-94cf-bf13726c9536 for instance 7bf0a9fb-ace7-4487-9453-fa095718cfc8 on hv-cinder-83998 May 17 22:12:32.315342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-8aede205-f1e5-4a03-9af7-7863f223b7b1 req-0e9ad8cc-e882-4f14-a7b5-19ba4c2b1dfe service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030621 May 17 22:12:32.315931 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 284/549] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:32.890846 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9ce352da-cd72-4bb0-8dc5-57bbce17e179 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:32.891501 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9ce352da-cd72-4bb0-8dc5-57bbce17e179 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:32.898797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ce352da-cd72-4bb0-8dc5-57bbce17e179 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:32.899718 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ce352da-cd72-4bb0-8dc5-57bbce17e179 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:32.903228 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ce352da-cd72-4bb0-8dc5-57bbce17e179 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:32.903228 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ce352da-cd72-4bb0-8dc5-57bbce17e179 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:33.040370 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9ce352da-cd72-4bb0-8dc5-57bbce17e179 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:33.042678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9ce352da-cd72-4bb0-8dc5-57bbce17e179 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:33.044201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9ce352da-cd72-4bb0-8dc5-57bbce17e179 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:33.045730 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9ce352da-cd72-4bb0-8dc5-57bbce17e179 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.159733 May 17 22:12:33.046354 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 266/550] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:32 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:33.053465 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-abf6215c-1ae2-4df8-8a52-fff0186efdd8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:33.054160 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-abf6215c-1ae2-4df8-8a52-fff0186efdd8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:33.060895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-abf6215c-1ae2-4df8-8a52-fff0186efdd8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:33.061388 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-abf6215c-1ae2-4df8-8a52-fff0186efdd8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:33.062158 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-abf6215c-1ae2-4df8-8a52-fff0186efdd8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:33.062594 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-abf6215c-1ae2-4df8-8a52-fff0186efdd8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:33.147238 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5f7791c2-458f-40c0-8a15-94041596256c tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:33.147848 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5f7791c2-458f-40c0-8a15-94041596256c tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:33.153711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f7791c2-458f-40c0-8a15-94041596256c tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:33.154907 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f7791c2-458f-40c0-8a15-94041596256c tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:33.155892 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f7791c2-458f-40c0-8a15-94041596256c tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:33.156215 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f7791c2-458f-40c0-8a15-94041596256c tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:33.208222 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-abf6215c-1ae2-4df8-8a52-fff0186efdd8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:33.216116 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-abf6215c-1ae2-4df8-8a52-fff0186efdd8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1512 microversion: 2.1 time: 0.166846 May 17 22:12:33.217404 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 285/551] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:33 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:33.297462 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5f7791c2-458f-40c0-8a15-94041596256c tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:33.304753 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5f7791c2-458f-40c0-8a15-94041596256c tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.161260 May 17 22:12:33.305322 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 267/552] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:33 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:33.339497 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ea02a343-0400-4fdf-af80-d9b687cbeb62 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1021890707"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:33.345887 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ea02a343-0400-4fdf-af80-d9b687cbeb62 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:33.346016 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ea02a343-0400-4fdf-af80-d9b687cbeb62 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:33.346489 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ea02a343-0400-4fdf-af80-d9b687cbeb62 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:33.347296 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ea02a343-0400-4fdf-af80-d9b687cbeb62 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:33.348010 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ea02a343-0400-4fdf-af80-d9b687cbeb62 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:33.472015 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.network.security_group_api [None req-ea02a343-0400-4fdf-af80-d9b687cbeb62 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Adding security group 6bbd6b68-fd1b-4a30-8743-d3d3eede093c to port 6b82dab7-02cb-4cc1-a078-91095811826f May 17 22:12:34.064964 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-41506041-a245-4ca1-a44f-e58c10e5c1f5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:34.066205 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-41506041-a245-4ca1-a44f-e58c10e5c1f5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:34.073854 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41506041-a245-4ca1-a44f-e58c10e5c1f5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:34.075275 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41506041-a245-4ca1-a44f-e58c10e5c1f5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:34.077000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41506041-a245-4ca1-a44f-e58c10e5c1f5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:34.077438 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41506041-a245-4ca1-a44f-e58c10e5c1f5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:34.096851 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ea02a343-0400-4fdf-af80-d9b687cbeb62 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "POST /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/action" status: 202 len: 0 microversion: 2.1 time: 0.761257 May 17 22:12:34.097768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 286/553] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:12:33 2022] POST /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:12:34.105992 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-acbaf4df-a8a8-4f2c-98dc-017550422bd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:34.106600 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-acbaf4df-a8a8-4f2c-98dc-017550422bd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:34.119051 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-acbaf4df-a8a8-4f2c-98dc-017550422bd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:34.119757 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-acbaf4df-a8a8-4f2c-98dc-017550422bd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:34.120709 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-acbaf4df-a8a8-4f2c-98dc-017550422bd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:34.121842 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-acbaf4df-a8a8-4f2c-98dc-017550422bd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:34.690355 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-41506041-a245-4ca1-a44f-e58c10e5c1f5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:34.708284 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-acbaf4df-a8a8-4f2c-98dc-017550422bd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:34.731053 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-acbaf4df-a8a8-4f2c-98dc-017550422bd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1759 microversion: 2.1 time: 0.629009 May 17 22:12:34.743234 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-41506041-a245-4ca1-a44f-e58c10e5c1f5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:34.743234 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-41506041-a245-4ca1-a44f-e58c10e5c1f5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:34.743234 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-41506041-a245-4ca1-a44f-e58c10e5c1f5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.675811 May 17 22:12:34.743641 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 268/554] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:34 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:34.749554 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 287/555] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:34 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1759 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:34.756187 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-aaf40566-2f28-470f-a7df-92fa654ba45d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:34.756595 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-355dfa51-a191-4b5e-a564-2f5a70bd4b02 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:34.757217 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-355dfa51-a191-4b5e-a564-2f5a70bd4b02 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:34.758401 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-aaf40566-2f28-470f-a7df-92fa654ba45d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:34.768162 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aaf40566-2f28-470f-a7df-92fa654ba45d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:34.770095 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aaf40566-2f28-470f-a7df-92fa654ba45d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:34.771159 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aaf40566-2f28-470f-a7df-92fa654ba45d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:34.771817 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-aaf40566-2f28-470f-a7df-92fa654ba45d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:34.776958 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-355dfa51-a191-4b5e-a564-2f5a70bd4b02 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:34.777416 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-355dfa51-a191-4b5e-a564-2f5a70bd4b02 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:34.778324 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-355dfa51-a191-4b5e-a564-2f5a70bd4b02 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:34.778763 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-355dfa51-a191-4b5e-a564-2f5a70bd4b02 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:35.117070 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-355dfa51-a191-4b5e-a564-2f5a70bd4b02 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:35.124318 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-355dfa51-a191-4b5e-a564-2f5a70bd4b02 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1512 microversion: 2.1 time: 0.386955 May 17 22:12:35.128466 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 269/556] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:34 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1512 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:35.146838 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-68906f51-b440-4fcd-9867-9fda650899e6 req-3d29a11d-ca0a-4fe7-8d0a-af2848d68d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c468659-e42a-4284-9a0c-39aa262bd9a5", "tag": "6b82dab7-02cb-4cc1-a078-91095811826f"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:35.147956 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-aaf40566-2f28-470f-a7df-92fa654ba45d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:35.159443 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-aaf40566-2f28-470f-a7df-92fa654ba45d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.407873 May 17 22:12:35.160682 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 288/557] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:34 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:35.164484 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-68906f51-b440-4fcd-9867-9fda650899e6 req-3d29a11d-ca0a-4fe7-8d0a-af2848d68d19 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:35.164934 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-68906f51-b440-4fcd-9867-9fda650899e6 req-3d29a11d-ca0a-4fe7-8d0a-af2848d68d19 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:35.177313 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-68906f51-b440-4fcd-9867-9fda650899e6 req-3d29a11d-ca0a-4fe7-8d0a-af2848d68d19 service nova] Creating event network-changed:6b82dab7-02cb-4cc1-a078-91095811826f for instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 on hv-cinder-83998 May 17 22:12:35.182515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-68906f51-b440-4fcd-9867-9fda650899e6 req-3d29a11d-ca0a-4fe7-8d0a-af2848d68d19 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042637 May 17 22:12:35.183526 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 270/558] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:35.755243 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4d506edc-e965-4437-a49b-b7650f62beae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:35.756361 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4d506edc-e965-4437-a49b-b7650f62beae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:35.762813 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4d506edc-e965-4437-a49b-b7650f62beae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:35.763474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4d506edc-e965-4437-a49b-b7650f62beae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:35.765345 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4d506edc-e965-4437-a49b-b7650f62beae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:35.765778 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4d506edc-e965-4437-a49b-b7650f62beae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:35.918321 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4d506edc-e965-4437-a49b-b7650f62beae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:35.928032 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4d506edc-e965-4437-a49b-b7650f62beae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:35.929524 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4d506edc-e965-4437-a49b-b7650f62beae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:35.930674 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4d506edc-e965-4437-a49b-b7650f62beae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.179426 May 17 22:12:35.931254 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 289/559] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:35 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:36.146147 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ce3226ac-d5d4-4849-a0a9-4ada226aa561 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:36.146848 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ce3226ac-d5d4-4849-a0a9-4ada226aa561 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:36.153576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ce3226ac-d5d4-4849-a0a9-4ada226aa561 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:36.154030 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ce3226ac-d5d4-4849-a0a9-4ada226aa561 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:36.154815 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ce3226ac-d5d4-4849-a0a9-4ada226aa561 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:36.155283 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ce3226ac-d5d4-4849-a0a9-4ada226aa561 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:36.177141 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1795054b-f969-4106-a2e2-7a9e6a4f6cce tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:36.177861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1795054b-f969-4106-a2e2-7a9e6a4f6cce tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:36.185636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1795054b-f969-4106-a2e2-7a9e6a4f6cce tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:36.186168 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1795054b-f969-4106-a2e2-7a9e6a4f6cce tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:36.187014 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1795054b-f969-4106-a2e2-7a9e6a4f6cce tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:36.187542 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1795054b-f969-4106-a2e2-7a9e6a4f6cce tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:36.225545 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ce3226ac-d5d4-4849-a0a9-4ada226aa561 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:36.233363 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ce3226ac-d5d4-4849-a0a9-4ada226aa561 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1470 microversion: 2.1 time: 0.092527 May 17 22:12:36.234376 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 271/560] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:36 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1470 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:36.334825 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1795054b-f969-4106-a2e2-7a9e6a4f6cce tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:36.342488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1795054b-f969-4106-a2e2-7a9e6a4f6cce tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.169247 May 17 22:12:36.343815 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 290/561] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:36 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:36.950340 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a4eafbdf-2d17-4fbf-ab99-eacc87e6c5e0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:36.951406 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a4eafbdf-2d17-4fbf-ab99-eacc87e6c5e0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:36.957996 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a4eafbdf-2d17-4fbf-ab99-eacc87e6c5e0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:36.958524 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a4eafbdf-2d17-4fbf-ab99-eacc87e6c5e0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:36.959578 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a4eafbdf-2d17-4fbf-ab99-eacc87e6c5e0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:36.960227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a4eafbdf-2d17-4fbf-ab99-eacc87e6c5e0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:37.097878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a4eafbdf-2d17-4fbf-ab99-eacc87e6c5e0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:37.106734 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a4eafbdf-2d17-4fbf-ab99-eacc87e6c5e0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:37.108323 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a4eafbdf-2d17-4fbf-ab99-eacc87e6c5e0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:37.109574 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a4eafbdf-2d17-4fbf-ab99-eacc87e6c5e0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.163475 May 17 22:12:37.110781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 272/562] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:36 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:37.199549 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-fe810e91-bce6-433b-862b-d8f5218c6a36 req-9ad341a2-a246-4f32-8de7-8144ff82047f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8865edd3-610c-4338-ae57-746c5b24b8cc", "name": "network-vif-deleted", "tag": "23425409-fb84-4741-87bb-e8ae34c58697"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:37.208591 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-fe810e91-bce6-433b-862b-d8f5218c6a36 req-9ad341a2-a246-4f32-8de7-8144ff82047f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:37.209117 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-fe810e91-bce6-433b-862b-d8f5218c6a36 req-9ad341a2-a246-4f32-8de7-8144ff82047f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:37.221996 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-fe810e91-bce6-433b-862b-d8f5218c6a36 req-9ad341a2-a246-4f32-8de7-8144ff82047f service nova] Creating event network-vif-deleted:23425409-fb84-4741-87bb-e8ae34c58697 for instance 8865edd3-610c-4338-ae57-746c5b24b8cc on hv-cinder-83998 May 17 22:12:37.227804 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-fe810e91-bce6-433b-862b-d8f5218c6a36 req-9ad341a2-a246-4f32-8de7-8144ff82047f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032174 May 17 22:12:37.228407 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 291/563] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:37.254434 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f40fcedc-4e81-4200-b2ae-ed20ef375e2c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:37.255316 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f40fcedc-4e81-4200-b2ae-ed20ef375e2c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:37.262273 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f40fcedc-4e81-4200-b2ae-ed20ef375e2c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:37.262848 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f40fcedc-4e81-4200-b2ae-ed20ef375e2c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:37.263874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f40fcedc-4e81-4200-b2ae-ed20ef375e2c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:37.264394 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f40fcedc-4e81-4200-b2ae-ed20ef375e2c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:37.329957 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f40fcedc-4e81-4200-b2ae-ed20ef375e2c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:37.337773 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f40fcedc-4e81-4200-b2ae-ed20ef375e2c tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1470 microversion: 2.1 time: 0.088973 May 17 22:12:37.338340 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 273/564] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:37 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1470 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:37.360539 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-64e0ad37-0951-4fc1-843e-5cb4effa9c4d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:37.361346 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-64e0ad37-0951-4fc1-843e-5cb4effa9c4d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:37.367666 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64e0ad37-0951-4fc1-843e-5cb4effa9c4d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:37.368115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64e0ad37-0951-4fc1-843e-5cb4effa9c4d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:37.368886 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64e0ad37-0951-4fc1-843e-5cb4effa9c4d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:37.369314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-64e0ad37-0951-4fc1-843e-5cb4effa9c4d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:37.507376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-64e0ad37-0951-4fc1-843e-5cb4effa9c4d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:37.515745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-64e0ad37-0951-4fc1-843e-5cb4effa9c4d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.159395 May 17 22:12:37.516326 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 292/565] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:37 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:38.128972 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9279d9f3-44f3-4d61-96fe-0a04d3c83548 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:38.129581 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9279d9f3-44f3-4d61-96fe-0a04d3c83548 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:38.136404 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9279d9f3-44f3-4d61-96fe-0a04d3c83548 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:38.136855 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9279d9f3-44f3-4d61-96fe-0a04d3c83548 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:38.137634 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9279d9f3-44f3-4d61-96fe-0a04d3c83548 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:38.138099 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9279d9f3-44f3-4d61-96fe-0a04d3c83548 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:38.280888 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9279d9f3-44f3-4d61-96fe-0a04d3c83548 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:38.291345 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9279d9f3-44f3-4d61-96fe-0a04d3c83548 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:38.292854 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9279d9f3-44f3-4d61-96fe-0a04d3c83548 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:38.294217 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9279d9f3-44f3-4d61-96fe-0a04d3c83548 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.169581 May 17 22:12:38.294788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 274/566] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:38 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:38.355696 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-183f1035-8d56-4f49-8131-06ea0da94022 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:38.356294 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-183f1035-8d56-4f49-8131-06ea0da94022 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:38.362719 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-183f1035-8d56-4f49-8131-06ea0da94022 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:38.363197 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-183f1035-8d56-4f49-8131-06ea0da94022 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:38.363973 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-183f1035-8d56-4f49-8131-06ea0da94022 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:38.364406 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-183f1035-8d56-4f49-8131-06ea0da94022 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:38.430742 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-183f1035-8d56-4f49-8131-06ea0da94022 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:38.439297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-183f1035-8d56-4f49-8131-06ea0da94022 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1470 microversion: 2.1 time: 0.086720 May 17 22:12:38.439794 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 293/567] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:38 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1470 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:38.532844 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2f378c7a-0ffd-49dd-941d-948759f0605d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:38.533475 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2f378c7a-0ffd-49dd-941d-948759f0605d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:38.539357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2f378c7a-0ffd-49dd-941d-948759f0605d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:38.539803 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2f378c7a-0ffd-49dd-941d-948759f0605d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:38.540702 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2f378c7a-0ffd-49dd-941d-948759f0605d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:38.541299 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2f378c7a-0ffd-49dd-941d-948759f0605d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:38.673902 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2f378c7a-0ffd-49dd-941d-948759f0605d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:38.683663 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2f378c7a-0ffd-49dd-941d-948759f0605d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.154653 May 17 22:12:38.695145 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 275/568] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:38 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:39.312823 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-792b6dee-6a06-470d-bee1-b6e119fd66bb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:39.314387 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-792b6dee-6a06-470d-bee1-b6e119fd66bb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:39.320812 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-792b6dee-6a06-470d-bee1-b6e119fd66bb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:39.321362 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-792b6dee-6a06-470d-bee1-b6e119fd66bb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:39.322200 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-792b6dee-6a06-470d-bee1-b6e119fd66bb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:39.322696 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-792b6dee-6a06-470d-bee1-b6e119fd66bb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:39.456443 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-144fd7b1-af23-4af0-a1be-2045ca9954cd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:39.456980 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-792b6dee-6a06-470d-bee1-b6e119fd66bb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:39.457388 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-144fd7b1-af23-4af0-a1be-2045ca9954cd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:39.463509 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-144fd7b1-af23-4af0-a1be-2045ca9954cd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:39.465400 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-792b6dee-6a06-470d-bee1-b6e119fd66bb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:39.466511 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-144fd7b1-af23-4af0-a1be-2045ca9954cd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:39.466898 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-792b6dee-6a06-470d-bee1-b6e119fd66bb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:39.467328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-144fd7b1-af23-4af0-a1be-2045ca9954cd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:39.467763 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-144fd7b1-af23-4af0-a1be-2045ca9954cd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:39.468084 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-792b6dee-6a06-470d-bee1-b6e119fd66bb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.159475 May 17 22:12:39.468836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 294/569] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:39 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:39.535471 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-144fd7b1-af23-4af0-a1be-2045ca9954cd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:39.545295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-144fd7b1-af23-4af0-a1be-2045ca9954cd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1470 microversion: 2.1 time: 0.092948 May 17 22:12:39.545873 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 276/570] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:39 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1470 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:39.701838 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-127d5b7f-6f57-4398-ba04-4d64d87d21ad tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:39.702363 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-127d5b7f-6f57-4398-ba04-4d64d87d21ad tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:39.708550 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-127d5b7f-6f57-4398-ba04-4d64d87d21ad tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:39.708999 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-127d5b7f-6f57-4398-ba04-4d64d87d21ad tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:39.709772 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-127d5b7f-6f57-4398-ba04-4d64d87d21ad tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:39.710204 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-127d5b7f-6f57-4398-ba04-4d64d87d21ad tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:39.864832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-127d5b7f-6f57-4398-ba04-4d64d87d21ad tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:39.864832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-127d5b7f-6f57-4398-ba04-4d64d87d21ad tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.159033 May 17 22:12:39.864832 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 295/571] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:39 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:40.486174 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7d2389df-63d3-4383-8723-b99a5e987914 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:40.487394 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7d2389df-63d3-4383-8723-b99a5e987914 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:40.494305 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d2389df-63d3-4383-8723-b99a5e987914 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:40.494761 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d2389df-63d3-4383-8723-b99a5e987914 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:40.495616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d2389df-63d3-4383-8723-b99a5e987914 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:40.496053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7d2389df-63d3-4383-8723-b99a5e987914 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:40.563382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b8329350-791e-4e0e-9a7d-b49de23f140f tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:40.564040 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b8329350-791e-4e0e-9a7d-b49de23f140f tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:40.571163 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b8329350-791e-4e0e-9a7d-b49de23f140f tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:40.572941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b8329350-791e-4e0e-9a7d-b49de23f140f tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:40.573759 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b8329350-791e-4e0e-9a7d-b49de23f140f tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:40.574241 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b8329350-791e-4e0e-9a7d-b49de23f140f tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:40.656042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b8329350-791e-4e0e-9a7d-b49de23f140f tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:40.659813 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7d2389df-63d3-4383-8723-b99a5e987914 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:40.671440 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7d2389df-63d3-4383-8723-b99a5e987914 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:40.673860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7d2389df-63d3-4383-8723-b99a5e987914 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:40.675070 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7d2389df-63d3-4383-8723-b99a5e987914 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.193126 May 17 22:12:40.686022 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b8329350-791e-4e0e-9a7d-b49de23f140f tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1470 microversion: 2.1 time: 0.116728 May 17 22:12:40.686233 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 277/572] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:40 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:40.686338 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 296/573] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:40 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1470 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:40.882617 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a7deee60-86df-40dd-90ab-1553f797af4b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:40.883252 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a7deee60-86df-40dd-90ab-1553f797af4b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:40.889959 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7deee60-86df-40dd-90ab-1553f797af4b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:40.890165 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7deee60-86df-40dd-90ab-1553f797af4b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:40.891159 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7deee60-86df-40dd-90ab-1553f797af4b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:40.891454 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a7deee60-86df-40dd-90ab-1553f797af4b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:41.037343 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a7deee60-86df-40dd-90ab-1553f797af4b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:41.045984 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a7deee60-86df-40dd-90ab-1553f797af4b tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.170115 May 17 22:12:41.046903 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 278/574] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:40 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:41.694501 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3b08ef9a-4a6a-40a2-962b-64e864bd2eb2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:41.695248 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7db5a0b6-5a9b-44b0-84f8-8dc7bcea18b7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:41.696317 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3b08ef9a-4a6a-40a2-962b-64e864bd2eb2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:41.698006 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7db5a0b6-5a9b-44b0-84f8-8dc7bcea18b7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:41.702802 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3b08ef9a-4a6a-40a2-962b-64e864bd2eb2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:41.703272 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3b08ef9a-4a6a-40a2-962b-64e864bd2eb2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:41.704864 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3b08ef9a-4a6a-40a2-962b-64e864bd2eb2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:41.705365 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3b08ef9a-4a6a-40a2-962b-64e864bd2eb2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:41.705625 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7db5a0b6-5a9b-44b0-84f8-8dc7bcea18b7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:41.706198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7db5a0b6-5a9b-44b0-84f8-8dc7bcea18b7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:41.707047 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7db5a0b6-5a9b-44b0-84f8-8dc7bcea18b7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:41.707586 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7db5a0b6-5a9b-44b0-84f8-8dc7bcea18b7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:41.798229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7db5a0b6-5a9b-44b0-84f8-8dc7bcea18b7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:41.808085 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7db5a0b6-5a9b-44b0-84f8-8dc7bcea18b7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1470 microversion: 2.1 time: 0.117452 May 17 22:12:41.811193 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 297/575] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:41 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1470 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:41.870168 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3b08ef9a-4a6a-40a2-962b-64e864bd2eb2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:41.882146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3b08ef9a-4a6a-40a2-962b-64e864bd2eb2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:41.883705 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3b08ef9a-4a6a-40a2-962b-64e864bd2eb2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:41.898854 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3b08ef9a-4a6a-40a2-962b-64e864bd2eb2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.194321 May 17 22:12:41.898854 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 279/576] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:41 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:42.064139 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-33e4d838-5929-46dd-9f6a-e9f9d22aa818 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:42.064758 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-33e4d838-5929-46dd-9f6a-e9f9d22aa818 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:42.070794 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33e4d838-5929-46dd-9f6a-e9f9d22aa818 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:42.071282 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33e4d838-5929-46dd-9f6a-e9f9d22aa818 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:42.072118 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33e4d838-5929-46dd-9f6a-e9f9d22aa818 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:42.072712 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-33e4d838-5929-46dd-9f6a-e9f9d22aa818 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:42.240869 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-33e4d838-5929-46dd-9f6a-e9f9d22aa818 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:42.248234 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-33e4d838-5929-46dd-9f6a-e9f9d22aa818 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.188402 May 17 22:12:42.248803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 298/577] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:42 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:42.826339 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-70458181-f68d-4ceb-83ca-795e6b4bf902 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:42.827186 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-70458181-f68d-4ceb-83ca-795e6b4bf902 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:42.833866 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-70458181-f68d-4ceb-83ca-795e6b4bf902 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:42.834398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-70458181-f68d-4ceb-83ca-795e6b4bf902 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:42.835317 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-70458181-f68d-4ceb-83ca-795e6b4bf902 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:42.835796 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-70458181-f68d-4ceb-83ca-795e6b4bf902 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:42.902112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-70458181-f68d-4ceb-83ca-795e6b4bf902 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:42.906054 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1f657818-a4b3-4125-8311-14cf15f4b36d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:42.915241 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1f657818-a4b3-4125-8311-14cf15f4b36d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:42.915380 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-70458181-f68d-4ceb-83ca-795e6b4bf902 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1470 microversion: 2.1 time: 0.087635 May 17 22:12:42.915380 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 280/578] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:42 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1470 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:42.915584 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1f657818-a4b3-4125-8311-14cf15f4b36d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:42.915584 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1f657818-a4b3-4125-8311-14cf15f4b36d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:42.915584 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1f657818-a4b3-4125-8311-14cf15f4b36d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:42.915584 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1f657818-a4b3-4125-8311-14cf15f4b36d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:43.060415 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1f657818-a4b3-4125-8311-14cf15f4b36d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:43.069441 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1f657818-a4b3-4125-8311-14cf15f4b36d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:43.072209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1f657818-a4b3-4125-8311-14cf15f4b36d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:43.072209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1f657818-a4b3-4125-8311-14cf15f4b36d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.170399 May 17 22:12:43.082611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 299/579] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:42 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:43.267997 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2bb047df-ca19-44b9-89c8-a71e18253d55 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:43.268607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2bb047df-ca19-44b9-89c8-a71e18253d55 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:43.274765 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bb047df-ca19-44b9-89c8-a71e18253d55 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:43.275339 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bb047df-ca19-44b9-89c8-a71e18253d55 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:43.276264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bb047df-ca19-44b9-89c8-a71e18253d55 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:43.276875 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2bb047df-ca19-44b9-89c8-a71e18253d55 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:43.412552 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2bb047df-ca19-44b9-89c8-a71e18253d55 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:43.419984 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2bb047df-ca19-44b9-89c8-a71e18253d55 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.155923 May 17 22:12:43.420537 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 281/580] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:43 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:43.927356 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d06d6817-8011-45a0-8db7-c3aa4b9bed5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:43.927965 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d06d6817-8011-45a0-8db7-c3aa4b9bed5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:43.934795 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d06d6817-8011-45a0-8db7-c3aa4b9bed5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:43.934795 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d06d6817-8011-45a0-8db7-c3aa4b9bed5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:43.935743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d06d6817-8011-45a0-8db7-c3aa4b9bed5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:43.936176 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d06d6817-8011-45a0-8db7-c3aa4b9bed5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:44.003722 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d06d6817-8011-45a0-8db7-c3aa4b9bed5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:44.011412 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d06d6817-8011-45a0-8db7-c3aa4b9bed5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1470 microversion: 2.1 time: 0.087930 May 17 22:12:44.012166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 300/581] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:43 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1470 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:44.090784 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-332c5673-8a60-44bc-89ca-ae77ace264cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:44.091418 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-332c5673-8a60-44bc-89ca-ae77ace264cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:44.098310 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-332c5673-8a60-44bc-89ca-ae77ace264cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:44.098763 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-332c5673-8a60-44bc-89ca-ae77ace264cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:44.099627 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-332c5673-8a60-44bc-89ca-ae77ace264cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:44.100066 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-332c5673-8a60-44bc-89ca-ae77ace264cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:44.243633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-332c5673-8a60-44bc-89ca-ae77ace264cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:44.252447 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-332c5673-8a60-44bc-89ca-ae77ace264cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:44.254834 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-332c5673-8a60-44bc-89ca-ae77ace264cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:44.256555 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-332c5673-8a60-44bc-89ca-ae77ace264cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.169703 May 17 22:12:44.257270 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 282/582] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:44 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:44.437529 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fd7c8065-a9aa-4333-91b0-f00c93153d35 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:44.438994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fd7c8065-a9aa-4333-91b0-f00c93153d35 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:44.445446 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd7c8065-a9aa-4333-91b0-f00c93153d35 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:44.445947 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd7c8065-a9aa-4333-91b0-f00c93153d35 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:44.446745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd7c8065-a9aa-4333-91b0-f00c93153d35 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:44.447337 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd7c8065-a9aa-4333-91b0-f00c93153d35 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:44.581239 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fd7c8065-a9aa-4333-91b0-f00c93153d35 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:44.589967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fd7c8065-a9aa-4333-91b0-f00c93153d35 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.156549 May 17 22:12:44.590545 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 301/583] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:44 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:45.028695 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-240e5756-eb60-47ae-92db-d8b52e90a3af tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:45.029233 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-240e5756-eb60-47ae-92db-d8b52e90a3af tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:45.035168 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-240e5756-eb60-47ae-92db-d8b52e90a3af tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:45.035618 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-240e5756-eb60-47ae-92db-d8b52e90a3af tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:45.036375 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-240e5756-eb60-47ae-92db-d8b52e90a3af tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:45.036808 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-240e5756-eb60-47ae-92db-d8b52e90a3af tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:45.096350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-240e5756-eb60-47ae-92db-d8b52e90a3af tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:45.104045 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-240e5756-eb60-47ae-92db-d8b52e90a3af tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1470 microversion: 2.1 time: 0.079230 May 17 22:12:45.104606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 283/584] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:45 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1470 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:45.275877 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1b6c51ce-97f1-4af4-9ac0-a1250b28edae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:45.276529 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1b6c51ce-97f1-4af4-9ac0-a1250b28edae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:45.292698 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b6c51ce-97f1-4af4-9ac0-a1250b28edae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:45.292698 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b6c51ce-97f1-4af4-9ac0-a1250b28edae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:45.292698 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b6c51ce-97f1-4af4-9ac0-a1250b28edae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:45.292698 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1b6c51ce-97f1-4af4-9ac0-a1250b28edae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:45.589766 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1b6c51ce-97f1-4af4-9ac0-a1250b28edae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:45.598298 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1b6c51ce-97f1-4af4-9ac0-a1250b28edae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:45.599846 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1b6c51ce-97f1-4af4-9ac0-a1250b28edae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:45.601011 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1b6c51ce-97f1-4af4-9ac0-a1250b28edae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.329538 May 17 22:12:45.601576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 302/585] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:45 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:45.607131 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2891c845-8978-4214-aca7-123aca24f6f9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:45.607747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2891c845-8978-4214-aca7-123aca24f6f9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:45.614343 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2891c845-8978-4214-aca7-123aca24f6f9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:45.614785 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2891c845-8978-4214-aca7-123aca24f6f9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:45.615580 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2891c845-8978-4214-aca7-123aca24f6f9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:45.616012 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2891c845-8978-4214-aca7-123aca24f6f9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:45.742861 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2891c845-8978-4214-aca7-123aca24f6f9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:45.750051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2891c845-8978-4214-aca7-123aca24f6f9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.146712 May 17 22:12:45.750676 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 284/586] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:45 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:46.121790 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-eaa7081c-ee64-4b96-a0ce-60cee4ef587b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:46.122328 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-eaa7081c-ee64-4b96-a0ce-60cee4ef587b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:46.128770 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eaa7081c-ee64-4b96-a0ce-60cee4ef587b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:46.129217 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eaa7081c-ee64-4b96-a0ce-60cee4ef587b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:46.129987 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eaa7081c-ee64-4b96-a0ce-60cee4ef587b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:46.130419 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eaa7081c-ee64-4b96-a0ce-60cee4ef587b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:46.161003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eaa7081c-ee64-4b96-a0ce-60cee4ef587b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:46.161789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eaa7081c-ee64-4b96-a0ce-60cee4ef587b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:46.161789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-eaa7081c-ee64-4b96-a0ce-60cee4ef587b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lazy-loading 'fault' on Instance uuid 8865edd3-610c-4338-ae57-746c5b24b8cc {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:12:46.214773 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-eaa7081c-ee64-4b96-a0ce-60cee4ef587b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:46.222118 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-eaa7081c-ee64-4b96-a0ce-60cee4ef587b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1308 microversion: 2.1 time: 0.104316 May 17 22:12:46.222680 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 303/587] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:46 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:46.620298 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4a302515-8c13-4233-b63b-851d55ca6bb6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:46.620906 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4a302515-8c13-4233-b63b-851d55ca6bb6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:46.627362 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4a302515-8c13-4233-b63b-851d55ca6bb6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:46.627809 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4a302515-8c13-4233-b63b-851d55ca6bb6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:46.628578 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4a302515-8c13-4233-b63b-851d55ca6bb6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:46.629018 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4a302515-8c13-4233-b63b-851d55ca6bb6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:46.754345 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4a302515-8c13-4233-b63b-851d55ca6bb6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:46.762787 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4a302515-8c13-4233-b63b-851d55ca6bb6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:46.764306 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4a302515-8c13-4233-b63b-851d55ca6bb6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:46.765458 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4a302515-8c13-4233-b63b-851d55ca6bb6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.150214 May 17 22:12:46.766023 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 285/588] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:46 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:46.766695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fefefae1-ffe2-48da-83db-032fd8dad4c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:46.767493 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fefefae1-ffe2-48da-83db-032fd8dad4c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:46.773767 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fefefae1-ffe2-48da-83db-032fd8dad4c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:46.774213 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fefefae1-ffe2-48da-83db-032fd8dad4c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:46.774979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fefefae1-ffe2-48da-83db-032fd8dad4c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:46.775438 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fefefae1-ffe2-48da-83db-032fd8dad4c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:46.907768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fefefae1-ffe2-48da-83db-032fd8dad4c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:46.912966 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fefefae1-ffe2-48da-83db-032fd8dad4c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.150595 May 17 22:12:46.913513 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 304/589] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:46 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:47.239733 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7b5b6c8d-e135-4620-9413-f34095d62c87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:47.240347 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7b5b6c8d-e135-4620-9413-f34095d62c87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:47.246241 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b5b6c8d-e135-4620-9413-f34095d62c87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:47.246690 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b5b6c8d-e135-4620-9413-f34095d62c87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:47.247488 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b5b6c8d-e135-4620-9413-f34095d62c87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:47.247926 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b5b6c8d-e135-4620-9413-f34095d62c87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:47.277885 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b5b6c8d-e135-4620-9413-f34095d62c87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:47.278322 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7b5b6c8d-e135-4620-9413-f34095d62c87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:47.278761 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-7b5b6c8d-e135-4620-9413-f34095d62c87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lazy-loading 'fault' on Instance uuid 8865edd3-610c-4338-ae57-746c5b24b8cc {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:12:47.318544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7b5b6c8d-e135-4620-9413-f34095d62c87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:47.325738 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7b5b6c8d-e135-4620-9413-f34095d62c87 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 200 len: 1308 microversion: 2.1 time: 0.089853 May 17 22:12:47.326304 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 286/590] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:47 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:47.784968 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9fe0cf3e-6309-4252-b905-65691da2718e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:47.785568 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9fe0cf3e-6309-4252-b905-65691da2718e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:47.791929 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9fe0cf3e-6309-4252-b905-65691da2718e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:47.792415 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9fe0cf3e-6309-4252-b905-65691da2718e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:47.793177 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9fe0cf3e-6309-4252-b905-65691da2718e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:47.793605 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9fe0cf3e-6309-4252-b905-65691da2718e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:47.931351 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-275f09bb-10cf-45c2-af82-acce29037ffd tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:47.931920 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-275f09bb-10cf-45c2-af82-acce29037ffd tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:47.934915 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9fe0cf3e-6309-4252-b905-65691da2718e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:47.939500 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-275f09bb-10cf-45c2-af82-acce29037ffd tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:47.940115 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-275f09bb-10cf-45c2-af82-acce29037ffd tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:47.940947 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-275f09bb-10cf-45c2-af82-acce29037ffd tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:47.941389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-275f09bb-10cf-45c2-af82-acce29037ffd tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:47.944699 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9fe0cf3e-6309-4252-b905-65691da2718e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:47.946271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9fe0cf3e-6309-4252-b905-65691da2718e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:47.947535 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9fe0cf3e-6309-4252-b905-65691da2718e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.167075 May 17 22:12:47.948170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 305/591] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:47 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:48.067413 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-275f09bb-10cf-45c2-af82-acce29037ffd tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:48.074484 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-275f09bb-10cf-45c2-af82-acce29037ffd tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.148191 May 17 22:12:48.075044 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 287/592] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:47 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:48.343049 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-881b9011-2ba9-44d8-8923-1b000641575a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:48.343678 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-881b9011-2ba9-44d8-8923-1b000641575a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: 8865edd3-610c-4338-ae57-746c5b24b8cc] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:48.349790 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-881b9011-2ba9-44d8-8923-1b000641575a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:48.350222 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-881b9011-2ba9-44d8-8923-1b000641575a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:48.350973 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-881b9011-2ba9-44d8-8923-1b000641575a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:48.351446 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-881b9011-2ba9-44d8-8923-1b000641575a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:48.364156 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-881b9011-2ba9-44d8-8923-1b000641575a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] HTTP exception thrown: Instance 8865edd3-610c-4338-ae57-746c5b24b8cc could not be found. May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-881b9011-2ba9-44d8-8923-1b000641575a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Request method failure captured: May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc HTTP/1.1 May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB1utMyXq5LiOrNqcnyb8gvKm24hn8Ajzg6igYG2VQT-PlVOJQCAIKv2XGApT7FpAC4HPBrL01sTMOrAjke6llEczV9PLhGgX_IvnrP6VyBmVX6H7EWJGsh8AIryvUPsMv3-D7yjGrtbcJeqN2Zb_v4dTB45qdV6831EOsmPOhxtzpo May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 93c1c0a74d6a4392947ee727aa1d3da3 May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-VolumesSnapshotTestJSON-361954781 May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:12:48.365737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:12:48.367448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/93c1c0a74d6a4392947ee727aa1d3da3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_93c1c0a74d6a4392947ee727aa1d3da3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/93c1c0a74d6a4392947ee727aa1d3da3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/93c1c0a74d6a4392947ee727aa1d3da3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:12:48.367448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-VolumesSnapshotTestJSON-361954781 May 17 22:12:48.367448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 93c1c0a74d6a4392947ee727aa1d3da3 May 17 22:12:48.367448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-361954781 May 17 22:12:48.367448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-VolumesSnapshotTestJSON-361954781-project May 17 22:12:48.367448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:12:48.367448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:12:48.367448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 98f1a5f6023e47c8b84edab34b308094 May 17 22:12:48.367448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-VolumesSnapshotTestJSON-361954781-project May 17 22:12:48.367448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:12:48.367448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 8865edd3-610c-4338-ae57-746c5b24b8cc could not be found. May 17 22:12:48.367448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '8865edd3-610c-4338-ae57-746c5b24b8cc'} May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8865edd3-610c-4338-ae57-746c5b24b8cc could not be found. May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:12:48.368394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8865edd3-610c-4338-ae57-746c5b24b8cc could not be found. May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8865edd3-610c-4338-ae57-746c5b24b8cc could not be found. May 17 22:12:48.369882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:12:48.371199 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-881b9011-2ba9-44d8-8923-1b000641575a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Returning 404 to user: Instance 8865edd3-610c-4338-ae57-746c5b24b8cc could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:12:48.371199 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-881b9011-2ba9-44d8-8923-1b000641575a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc" status: 404 len: 111 microversion: 2.1 time: 0.027925 May 17 22:12:48.371199 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 306/593] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:48 2022] GET /compute/v2.1/servers/8865edd3-610c-4338-ae57-746c5b24b8cc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:12:48.777588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c0ecbe06-06f8-4ab0-ab44-b5be92be3779 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:48.777588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c0ecbe06-06f8-4ab0-ab44-b5be92be3779 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:48.787174 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c0ecbe06-06f8-4ab0-ab44-b5be92be3779 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:48.787174 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c0ecbe06-06f8-4ab0-ab44-b5be92be3779 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:48.787174 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c0ecbe06-06f8-4ab0-ab44-b5be92be3779 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:48.787174 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c0ecbe06-06f8-4ab0-ab44-b5be92be3779 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:48.866942 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-c0ecbe06-06f8-4ab0-ab44-b5be92be3779 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lazy-loading 'services' on Instance uuid 65e6e64e-c18e-4856-9a95-0833c10482ee {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:12:48.966755 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef3e9f22-8c31-4c5c-8397-f1f90c22e04d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:48.967342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ef3e9f22-8c31-4c5c-8397-f1f90c22e04d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:48.974227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef3e9f22-8c31-4c5c-8397-f1f90c22e04d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:48.974673 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef3e9f22-8c31-4c5c-8397-f1f90c22e04d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:48.975501 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef3e9f22-8c31-4c5c-8397-f1f90c22e04d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:48.975930 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef3e9f22-8c31-4c5c-8397-f1f90c22e04d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:49.105815 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef3e9f22-8c31-4c5c-8397-f1f90c22e04d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:49.115427 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef3e9f22-8c31-4c5c-8397-f1f90c22e04d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:49.117001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef3e9f22-8c31-4c5c-8397-f1f90c22e04d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:49.118139 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ef3e9f22-8c31-4c5c-8397-f1f90c22e04d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.155605 May 17 22:12:49.118692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 307/594] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:48 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:49.122992 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-089bb22c-a72f-4ecb-90c0-1c508e618ede tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:49.123640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-089bb22c-a72f-4ecb-90c0-1c508e618ede tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:49.129883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-089bb22c-a72f-4ecb-90c0-1c508e618ede tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:49.130327 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-089bb22c-a72f-4ecb-90c0-1c508e618ede tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:49.131089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-089bb22c-a72f-4ecb-90c0-1c508e618ede tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:49.131556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-089bb22c-a72f-4ecb-90c0-1c508e618ede tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:49.171043 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c0ecbe06-06f8-4ab0-ab44-b5be92be3779 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "DELETE /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/os-volume_attachments/0a00d9f1-b3c1-40af-ae3e-c564426f56b7" status: 202 len: 0 microversion: 2.1 time: 0.401311 May 17 22:12:49.172868 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 288/595] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 17 22:12:48 2022] DELETE /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/os-volume_attachments/0a00d9f1-b3c1-40af-ae3e-c564426f56b7 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:12:49.272173 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-089bb22c-a72f-4ecb-90c0-1c508e618ede tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:49.279568 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-089bb22c-a72f-4ecb-90c0-1c508e618ede tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.159854 May 17 22:12:49.280123 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 308/596] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:49 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:49.990008 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dd097c9a-96e9-4345-b1f7-4cbd35fdd05f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1a5b4fb-9987-43f9-a237-264fec6faf4f"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:49.991218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dd097c9a-96e9-4345-b1f7-4cbd35fdd05f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:49.997362 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dd097c9a-96e9-4345-b1f7-4cbd35fdd05f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:49.997802 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dd097c9a-96e9-4345-b1f7-4cbd35fdd05f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:49.998556 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dd097c9a-96e9-4345-b1f7-4cbd35fdd05f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:49.999338 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dd097c9a-96e9-4345-b1f7-4cbd35fdd05f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:50.137005 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d46a667a-6afa-417e-b64f-d7bb6c6cd98e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:50.138052 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d46a667a-6afa-417e-b64f-d7bb6c6cd98e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:50.144579 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d46a667a-6afa-417e-b64f-d7bb6c6cd98e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:50.145025 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d46a667a-6afa-417e-b64f-d7bb6c6cd98e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:50.145792 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d46a667a-6afa-417e-b64f-d7bb6c6cd98e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:50.146225 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d46a667a-6afa-417e-b64f-d7bb6c6cd98e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:50.277520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d46a667a-6afa-417e-b64f-d7bb6c6cd98e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:50.287000 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d46a667a-6afa-417e-b64f-d7bb6c6cd98e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:50.289388 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d46a667a-6afa-417e-b64f-d7bb6c6cd98e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:50.290533 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d46a667a-6afa-417e-b64f-d7bb6c6cd98e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.157422 May 17 22:12:50.291160 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 309/597] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:50 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:50.296995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d17c9b80-f6b5-4f23-b436-e7d545440b5a tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:50.298504 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d17c9b80-f6b5-4f23-b436-e7d545440b5a tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:50.305131 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d17c9b80-f6b5-4f23-b436-e7d545440b5a tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:50.305581 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d17c9b80-f6b5-4f23-b436-e7d545440b5a tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:50.306687 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d17c9b80-f6b5-4f23-b436-e7d545440b5a tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:50.307526 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d17c9b80-f6b5-4f23-b436-e7d545440b5a tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:50.444420 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d17c9b80-f6b5-4f23-b436-e7d545440b5a tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:50.451595 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d17c9b80-f6b5-4f23-b436-e7d545440b5a tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.158265 May 17 22:12:50.452153 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 310/598] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:50 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:51.309736 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bb921a1e-8607-485d-ae38-b2886e855f53 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:51.310603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bb921a1e-8607-485d-ae38-b2886e855f53 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:51.316998 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bb921a1e-8607-485d-ae38-b2886e855f53 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:51.317449 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bb921a1e-8607-485d-ae38-b2886e855f53 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:51.318214 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bb921a1e-8607-485d-ae38-b2886e855f53 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:51.318645 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bb921a1e-8607-485d-ae38-b2886e855f53 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:51.444992 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bb921a1e-8607-485d-ae38-b2886e855f53 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:51.453268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bb921a1e-8607-485d-ae38-b2886e855f53 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:51.454994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bb921a1e-8607-485d-ae38-b2886e855f53 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:51.456175 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bb921a1e-8607-485d-ae38-b2886e855f53 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.150336 May 17 22:12:51.456747 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 311/599] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:51 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:51.471491 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b05f2f59-cff3-41ae-839f-109db999d691 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:51.472091 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b05f2f59-cff3-41ae-839f-109db999d691 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:51.478045 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b05f2f59-cff3-41ae-839f-109db999d691 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:51.478490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b05f2f59-cff3-41ae-839f-109db999d691 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:51.479296 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b05f2f59-cff3-41ae-839f-109db999d691 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:51.479734 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b05f2f59-cff3-41ae-839f-109db999d691 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:51.607351 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b05f2f59-cff3-41ae-839f-109db999d691 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:51.614510 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b05f2f59-cff3-41ae-839f-109db999d691 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.147192 May 17 22:12:51.615061 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 312/600] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:51 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:52.474476 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ec04f4aa-ccde-4062-890a-e799b8878325 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:52.477198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ec04f4aa-ccde-4062-890a-e799b8878325 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:52.481595 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec04f4aa-ccde-4062-890a-e799b8878325 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:52.482038 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec04f4aa-ccde-4062-890a-e799b8878325 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:52.483140 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec04f4aa-ccde-4062-890a-e799b8878325 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:52.483585 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ec04f4aa-ccde-4062-890a-e799b8878325 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:52.614751 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ec04f4aa-ccde-4062-890a-e799b8878325 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:52.624622 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ec04f4aa-ccde-4062-890a-e799b8878325 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:52.626985 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ec04f4aa-ccde-4062-890a-e799b8878325 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:52.628186 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ec04f4aa-ccde-4062-890a-e799b8878325 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.157629 May 17 22:12:52.628749 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 313/601] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:52 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:52.633166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-2e2e4675-ec0a-42c5-8f61-93ebede992ed req-8408cab7-2def-42b6-b3a9-6c19a27df82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf0a9fb-ace7-4487-9453-fa095718cfc8", "name": "network-vif-plugged", "status": "completed", "tag": "b67e5a8d-71dd-4b27-94cf-bf13726c9536"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:52.643518 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-2e2e4675-ec0a-42c5-8f61-93ebede992ed req-8408cab7-2def-42b6-b3a9-6c19a27df82f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:52.644247 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-2e2e4675-ec0a-42c5-8f61-93ebede992ed req-8408cab7-2def-42b6-b3a9-6c19a27df82f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:52.661429 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-2e2e4675-ec0a-42c5-8f61-93ebede992ed req-8408cab7-2def-42b6-b3a9-6c19a27df82f service nova] Creating event network-vif-plugged:b67e5a8d-71dd-4b27-94cf-bf13726c9536 for instance 7bf0a9fb-ace7-4487-9453-fa095718cfc8 on hv-cinder-83998 May 17 22:12:52.666507 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-2e2e4675-ec0a-42c5-8f61-93ebede992ed req-8408cab7-2def-42b6-b3a9-6c19a27df82f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036686 May 17 22:12:52.667078 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 314/602] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:52.672088 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c140f698-dae5-4248-96f8-b3005727eeb9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:52.673425 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c140f698-dae5-4248-96f8-b3005727eeb9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:52.679239 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c140f698-dae5-4248-96f8-b3005727eeb9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:52.679681 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c140f698-dae5-4248-96f8-b3005727eeb9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:52.680430 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c140f698-dae5-4248-96f8-b3005727eeb9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:52.680854 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c140f698-dae5-4248-96f8-b3005727eeb9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:52.817168 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c140f698-dae5-4248-96f8-b3005727eeb9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:52.824785 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c140f698-dae5-4248-96f8-b3005727eeb9 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.156509 May 17 22:12:52.825574 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 315/603] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:52 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:53.646673 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-61909f52-c868-4045-978a-b9dc391185fd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:53.647337 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-61909f52-c868-4045-978a-b9dc391185fd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:53.653611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61909f52-c868-4045-978a-b9dc391185fd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:53.654063 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61909f52-c868-4045-978a-b9dc391185fd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:53.654833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61909f52-c868-4045-978a-b9dc391185fd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:53.655305 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61909f52-c868-4045-978a-b9dc391185fd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:53.783429 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-61909f52-c868-4045-978a-b9dc391185fd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:53.791735 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-61909f52-c868-4045-978a-b9dc391185fd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:53.793239 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-61909f52-c868-4045-978a-b9dc391185fd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:53.794397 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-61909f52-c868-4045-978a-b9dc391185fd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.151784 May 17 22:12:53.794956 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 316/604] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:53 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:12:53.841565 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b4e850ef-eaed-48bb-9186-f0b3637f84c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:53.842094 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b4e850ef-eaed-48bb-9186-f0b3637f84c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:53.848205 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b4e850ef-eaed-48bb-9186-f0b3637f84c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:53.848651 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b4e850ef-eaed-48bb-9186-f0b3637f84c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:53.849413 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b4e850ef-eaed-48bb-9186-f0b3637f84c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:53.849844 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b4e850ef-eaed-48bb-9186-f0b3637f84c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:53.893865 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dd097c9a-96e9-4345-b1f7-4cbd35fdd05f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "POST /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.909302 May 17 22:12:53.894959 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 289/605] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:12:49 2022] POST /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments => generated 194 bytes in 3912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:12:53.990649 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b4e850ef-eaed-48bb-9186-f0b3637f84c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:53.998653 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b4e850ef-eaed-48bb-9186-f0b3637f84c3 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.160835 May 17 22:12:53.999973 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 317/606] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:53 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:12:54.493244 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4643684c-9b95-492e-830c-bfaaddd20f64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:54.500496 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4643684c-9b95-492e-830c-bfaaddd20f64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:54.500901 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4643684c-9b95-492e-830c-bfaaddd20f64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:54.561951 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4643684c-9b95-492e-830c-bfaaddd20f64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Going to try to stop instance {{(pid=117594) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 22:12:54.774876 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4643684c-9b95-492e-830c-bfaaddd20f64 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "POST /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/action" status: 202 len: 0 microversion: 2.1 time: 0.286134 May 17 22:12:54.775897 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 290/607] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:12:54 2022] POST /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 22:12:54.783614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-66c08267-9ee4-42ff-b544-87a6b2e91789 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:54.784223 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-66c08267-9ee4-42ff-b544-87a6b2e91789 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:54.790632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66c08267-9ee4-42ff-b544-87a6b2e91789 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:54.791190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66c08267-9ee4-42ff-b544-87a6b2e91789 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:54.791957 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66c08267-9ee4-42ff-b544-87a6b2e91789 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:54.792444 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-66c08267-9ee4-42ff-b544-87a6b2e91789 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:54.812486 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-be586020-d395-471a-80d8-59932f551059 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:54.813849 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-be586020-d395-471a-80d8-59932f551059 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:54.820121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be586020-d395-471a-80d8-59932f551059 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:54.820566 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be586020-d395-471a-80d8-59932f551059 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:54.821411 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be586020-d395-471a-80d8-59932f551059 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:54.821843 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-be586020-d395-471a-80d8-59932f551059 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:55.006509 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-66c08267-9ee4-42ff-b544-87a6b2e91789 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:55.014896 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-66c08267-9ee4-42ff-b544-87a6b2e91789 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.235037 May 17 22:12:55.019090 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-be586020-d395-471a-80d8-59932f551059 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:55.020188 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 318/608] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:54 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:55.024783 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-795af8af-6d9d-4714-9f27-c5a8761b4fff tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:55.025455 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-795af8af-6d9d-4714-9f27-c5a8761b4fff tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:55.029633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-be586020-d395-471a-80d8-59932f551059 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:55.031377 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-795af8af-6d9d-4714-9f27-c5a8761b4fff tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:55.031509 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-be586020-d395-471a-80d8-59932f551059 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:55.032468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-795af8af-6d9d-4714-9f27-c5a8761b4fff tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:55.032608 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-be586020-d395-471a-80d8-59932f551059 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.224764 May 17 22:12:55.033160 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 291/609] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:54 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:55.033281 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-795af8af-6d9d-4714-9f27-c5a8761b4fff tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:55.033648 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-795af8af-6d9d-4714-9f27-c5a8761b4fff tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:55.159463 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-795af8af-6d9d-4714-9f27-c5a8761b4fff tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:55.166638 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-795af8af-6d9d-4714-9f27-c5a8761b4fff tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.145454 May 17 22:12:55.167214 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 319/610] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:55 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:56.037789 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9ae2d16e-23aa-46ef-8a96-4250a8744f43 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:56.038385 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9ae2d16e-23aa-46ef-8a96-4250a8744f43 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:56.044623 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ae2d16e-23aa-46ef-8a96-4250a8744f43 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:56.045063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ae2d16e-23aa-46ef-8a96-4250a8744f43 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:56.049038 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ae2d16e-23aa-46ef-8a96-4250a8744f43 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:56.049528 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ae2d16e-23aa-46ef-8a96-4250a8744f43 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:56.051379 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-62409ef3-fcd9-4a78-9dad-dfad59acf674 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:56.051985 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-62409ef3-fcd9-4a78-9dad-dfad59acf674 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:56.058416 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62409ef3-fcd9-4a78-9dad-dfad59acf674 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:56.058873 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62409ef3-fcd9-4a78-9dad-dfad59acf674 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:56.059680 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62409ef3-fcd9-4a78-9dad-dfad59acf674 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:56.060584 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-62409ef3-fcd9-4a78-9dad-dfad59acf674 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:56.246408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9ae2d16e-23aa-46ef-8a96-4250a8744f43 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:56.253780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9ae2d16e-23aa-46ef-8a96-4250a8744f43 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.219653 May 17 22:12:56.253945 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-62409ef3-fcd9-4a78-9dad-dfad59acf674 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:56.254350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 292/611] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:56 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:56.263525 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-312fa36c-e8a4-48b6-bec2-f4397b52544d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:56.263525 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-312fa36c-e8a4-48b6-bec2-f4397b52544d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:56.263723 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-62409ef3-fcd9-4a78-9dad-dfad59acf674 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:56.263993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-62409ef3-fcd9-4a78-9dad-dfad59acf674 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:56.264913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-312fa36c-e8a4-48b6-bec2-f4397b52544d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:56.265151 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-62409ef3-fcd9-4a78-9dad-dfad59acf674 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.218280 May 17 22:12:56.265359 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-312fa36c-e8a4-48b6-bec2-f4397b52544d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:56.267140 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 320/612] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:56 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:56.267266 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-312fa36c-e8a4-48b6-bec2-f4397b52544d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:56.267266 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-312fa36c-e8a4-48b6-bec2-f4397b52544d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:56.392948 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-312fa36c-e8a4-48b6-bec2-f4397b52544d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:56.400137 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-312fa36c-e8a4-48b6-bec2-f4397b52544d tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.144785 May 17 22:12:56.400692 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 293/613] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:56 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:57.271444 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-240ec957-3814-41d4-88b2-08fd78a24a5e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:57.272051 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-240ec957-3814-41d4-88b2-08fd78a24a5e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:57.278277 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-240ec957-3814-41d4-88b2-08fd78a24a5e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:57.278729 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-240ec957-3814-41d4-88b2-08fd78a24a5e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:57.279559 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-240ec957-3814-41d4-88b2-08fd78a24a5e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:57.279997 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-240ec957-3814-41d4-88b2-08fd78a24a5e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:57.285656 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4f2f1f31-7ba5-4601-9ca4-90082761ba62 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:57.286255 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4f2f1f31-7ba5-4601-9ca4-90082761ba62 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:57.292625 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4f2f1f31-7ba5-4601-9ca4-90082761ba62 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:57.293064 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4f2f1f31-7ba5-4601-9ca4-90082761ba62 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:57.293822 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4f2f1f31-7ba5-4601-9ca4-90082761ba62 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:57.294254 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4f2f1f31-7ba5-4601-9ca4-90082761ba62 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:57.467220 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-240ec957-3814-41d4-88b2-08fd78a24a5e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:57.474740 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-240ec957-3814-41d4-88b2-08fd78a24a5e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.207093 May 17 22:12:57.475682 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 321/614] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:57 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:57.478162 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4f2f1f31-7ba5-4601-9ca4-90082761ba62 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:57.480043 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-43ef1e53-cd71-40e1-8824-118e6147a9c5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:57.480548 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-43ef1e53-cd71-40e1-8824-118e6147a9c5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:57.486197 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43ef1e53-cd71-40e1-8824-118e6147a9c5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:57.486652 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43ef1e53-cd71-40e1-8824-118e6147a9c5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:57.486766 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4f2f1f31-7ba5-4601-9ca4-90082761ba62 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:57.487459 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43ef1e53-cd71-40e1-8824-118e6147a9c5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:57.487898 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-43ef1e53-cd71-40e1-8824-118e6147a9c5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:57.488182 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4f2f1f31-7ba5-4601-9ca4-90082761ba62 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:57.489318 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4f2f1f31-7ba5-4601-9ca4-90082761ba62 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.207743 May 17 22:12:57.489863 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 294/615] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:57 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:57.616774 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-43ef1e53-cd71-40e1-8824-118e6147a9c5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:57.624017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-43ef1e53-cd71-40e1-8824-118e6147a9c5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1314 microversion: 2.1 time: 0.147548 May 17 22:12:57.624576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 322/616] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:57 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:58.491987 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b7eee909-5538-449a-976b-7fdf92dee4c9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:58.494752 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b7eee909-5538-449a-976b-7fdf92dee4c9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:58.503455 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b7eee909-5538-449a-976b-7fdf92dee4c9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:58.503907 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b7eee909-5538-449a-976b-7fdf92dee4c9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:58.504724 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b7eee909-5538-449a-976b-7fdf92dee4c9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:58.505161 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b7eee909-5538-449a-976b-7fdf92dee4c9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:58.507901 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2631401d-51d9-4fa7-8dd7-cc023d6cd89b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:58.508510 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2631401d-51d9-4fa7-8dd7-cc023d6cd89b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:58.514632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2631401d-51d9-4fa7-8dd7-cc023d6cd89b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:58.515069 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2631401d-51d9-4fa7-8dd7-cc023d6cd89b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:58.516421 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2631401d-51d9-4fa7-8dd7-cc023d6cd89b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:58.517388 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2631401d-51d9-4fa7-8dd7-cc023d6cd89b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:58.767967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b7eee909-5538-449a-976b-7fdf92dee4c9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:58.776955 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b7eee909-5538-449a-976b-7fdf92dee4c9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.288734 May 17 22:12:58.778936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2631401d-51d9-4fa7-8dd7-cc023d6cd89b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:58.787085 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 295/617] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:58 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:58.792475 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8aa91d33-0455-47c2-9c7a-176e03b9c1a5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:58.793077 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8aa91d33-0455-47c2-9c7a-176e03b9c1a5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:58.794356 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2631401d-51d9-4fa7-8dd7-cc023d6cd89b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:58.795902 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2631401d-51d9-4fa7-8dd7-cc023d6cd89b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:58.797183 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2631401d-51d9-4fa7-8dd7-cc023d6cd89b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.293465 May 17 22:12:58.797749 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 323/618] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:58 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:12:58.798913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8aa91d33-0455-47c2-9c7a-176e03b9c1a5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:58.799653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8aa91d33-0455-47c2-9c7a-176e03b9c1a5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:58.800574 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8aa91d33-0455-47c2-9c7a-176e03b9c1a5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:58.801156 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8aa91d33-0455-47c2-9c7a-176e03b9c1a5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:58.919331 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-97c85c79-fb21-417b-8d53-b1062f22d7f9 req-ff5f4a9e-a8cc-43b7-b02f-791b5b1e9b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c568a7b-6b45-45c4-b60a-3514d7c43e6e", "name": "network-vif-plugged", "status": "completed", "tag": "501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:58.930536 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-97c85c79-fb21-417b-8d53-b1062f22d7f9 req-ff5f4a9e-a8cc-43b7-b02f-791b5b1e9b51 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:58.932005 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-97c85c79-fb21-417b-8d53-b1062f22d7f9 req-ff5f4a9e-a8cc-43b7-b02f-791b5b1e9b51 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:58.949283 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-97c85c79-fb21-417b-8d53-b1062f22d7f9 req-ff5f4a9e-a8cc-43b7-b02f-791b5b1e9b51 service nova] Creating event network-vif-plugged:501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e for instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e on hv-cinder-83998 May 17 22:12:58.954753 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-97c85c79-fb21-417b-8d53-b1062f22d7f9 req-ff5f4a9e-a8cc-43b7-b02f-791b5b1e9b51 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040736 May 17 22:12:58.955389 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 324/619] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:12:58.963205 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1579076135", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "networks": [{"uuid": "728fcf69-a03b-4660-ab19-7ef744bf8d9d"}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:12:59.009129 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8aa91d33-0455-47c2-9c7a-176e03b9c1a5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:59.016744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] validate_networks() for [('728fcf69-a03b-4660-ab19-7ef744bf8d9d', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:12:59.019642 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8aa91d33-0455-47c2-9c7a-176e03b9c1a5 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1498 microversion: 2.1 time: 0.231088 May 17 22:12:59.027205 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 296/620] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:58 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1498 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:59.399472 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:12:59.399926 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:12:59.400404 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:12:59.400811 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:12:59.401221 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:12:59.423910 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:59.424355 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:59.425195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:59.425763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:59.454275 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Getting quotas for project 93c1c0a74d6a4392947ee727aa1d3da3. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:12:59.458758 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Getting quotas for user 98f1a5f6023e47c8b84edab34b308094 and project 93c1c0a74d6a4392947ee727aa1d3da3. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:12:59.471802 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:12:59.474284 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:12:59.584805 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9881a588-47ca-49e4-aa3b-17146617a803 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625445 May 17 22:12:59.585417 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 325/621] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:12:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:12:59.595823 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9315463d-134e-40bf-9c1f-210c5b6c413f tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:59.596424 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9315463d-134e-40bf-9c1f-210c5b6c413f tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:59.650066 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9315463d-134e-40bf-9c1f-210c5b6c413f tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:12:59.657248 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9315463d-134e-40bf-9c1f-210c5b6c413f tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1219 microversion: 2.1 time: 0.065812 May 17 22:12:59.660878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 297/622] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:59 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:12:59.795351 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-56a272fe-300a-4ff5-9a2e-bfea074e1dd8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:59.795994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-56a272fe-300a-4ff5-9a2e-bfea074e1dd8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:59.802808 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-56a272fe-300a-4ff5-9a2e-bfea074e1dd8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:59.803594 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-56a272fe-300a-4ff5-9a2e-bfea074e1dd8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:59.804543 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-56a272fe-300a-4ff5-9a2e-bfea074e1dd8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:59.804985 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-56a272fe-300a-4ff5-9a2e-bfea074e1dd8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:59.815766 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f7d22ddb-0d66-4309-82c7-75948c599dda tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:12:59.816384 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f7d22ddb-0d66-4309-82c7-75948c599dda tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:12:59.822957 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7d22ddb-0d66-4309-82c7-75948c599dda tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:59.823445 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7d22ddb-0d66-4309-82c7-75948c599dda tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:12:59.824220 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7d22ddb-0d66-4309-82c7-75948c599dda tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:12:59.824829 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f7d22ddb-0d66-4309-82c7-75948c599dda tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:00.069435 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-56a272fe-300a-4ff5-9a2e-bfea074e1dd8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:00.074044 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f7d22ddb-0d66-4309-82c7-75948c599dda tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:00.077427 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-56a272fe-300a-4ff5-9a2e-bfea074e1dd8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.286139 May 17 22:13:00.079188 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 326/623] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:12:59 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:00.084953 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f7d22ddb-0d66-4309-82c7-75948c599dda tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:00.085113 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3a33216f-6746-4f98-956c-8a883d830223 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:00.085113 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3a33216f-6746-4f98-956c-8a883d830223 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:00.085829 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f7d22ddb-0d66-4309-82c7-75948c599dda tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:00.087224 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f7d22ddb-0d66-4309-82c7-75948c599dda tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.275737 May 17 22:13:00.088245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 298/624] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:12:59 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:13:00.091480 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3a33216f-6746-4f98-956c-8a883d830223 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:00.091934 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3a33216f-6746-4f98-956c-8a883d830223 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:00.092747 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3a33216f-6746-4f98-956c-8a883d830223 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:00.093187 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3a33216f-6746-4f98-956c-8a883d830223 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:00.118987 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3a33216f-6746-4f98-956c-8a883d830223 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:13:00.383800 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3a33216f-6746-4f98-956c-8a883d830223 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 204 len: 0 microversion: 2.1 time: 0.303063 May 17 22:13:00.384313 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 327/625] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:13:00 2022] DELETE /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:13:00.392713 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ccfa47e1-2947-4fd0-8326-ae2d28654eda tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:00.393352 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ccfa47e1-2947-4fd0-8326-ae2d28654eda tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:00.399250 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ccfa47e1-2947-4fd0-8326-ae2d28654eda tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:00.399728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ccfa47e1-2947-4fd0-8326-ae2d28654eda tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:00.400496 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ccfa47e1-2947-4fd0-8326-ae2d28654eda tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:00.400930 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ccfa47e1-2947-4fd0-8326-ae2d28654eda tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:00.533110 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ccfa47e1-2947-4fd0-8326-ae2d28654eda tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:00.540453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ccfa47e1-2947-4fd0-8326-ae2d28654eda tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1504 microversion: 2.1 time: 0.151753 May 17 22:13:00.541020 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 299/626] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:00 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:00.674635 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef5353d9-b6c6-4399-913e-7ae06d7dd084 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:00.675277 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ef5353d9-b6c6-4399-913e-7ae06d7dd084 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:00.681743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef5353d9-b6c6-4399-913e-7ae06d7dd084 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:00.682190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef5353d9-b6c6-4399-913e-7ae06d7dd084 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:00.682960 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef5353d9-b6c6-4399-913e-7ae06d7dd084 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:00.683421 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef5353d9-b6c6-4399-913e-7ae06d7dd084 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:00.745542 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ef5353d9-b6c6-4399-913e-7ae06d7dd084 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:00.753078 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ef5353d9-b6c6-4399-913e-7ae06d7dd084 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1223 microversion: 2.1 time: 0.082895 May 17 22:13:00.753637 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 328/627] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:00 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:01.096162 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-14a7d22d-1a59-4c53-8f8f-eac8e3ee2389 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:01.096772 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-14a7d22d-1a59-4c53-8f8f-eac8e3ee2389 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:01.103939 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-14a7d22d-1a59-4c53-8f8f-eac8e3ee2389 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:01.104394 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-14a7d22d-1a59-4c53-8f8f-eac8e3ee2389 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:01.105169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-14a7d22d-1a59-4c53-8f8f-eac8e3ee2389 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:01.105610 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-14a7d22d-1a59-4c53-8f8f-eac8e3ee2389 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:01.106785 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9cd38cf5-a8be-4299-8283-8583c2556b6f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:01.107458 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9cd38cf5-a8be-4299-8283-8583c2556b6f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:01.114887 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9cd38cf5-a8be-4299-8283-8583c2556b6f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:01.115389 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9cd38cf5-a8be-4299-8283-8583c2556b6f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:01.116159 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9cd38cf5-a8be-4299-8283-8583c2556b6f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:01.116761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9cd38cf5-a8be-4299-8283-8583c2556b6f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:01.300816 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9cd38cf5-a8be-4299-8283-8583c2556b6f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:01.308330 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-14a7d22d-1a59-4c53-8f8f-eac8e3ee2389 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:01.310013 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9cd38cf5-a8be-4299-8283-8583c2556b6f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:01.311959 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9cd38cf5-a8be-4299-8283-8583c2556b6f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:01.313157 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9cd38cf5-a8be-4299-8283-8583c2556b6f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.210153 May 17 22:13:01.313914 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 329/628] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:13:01 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:13:01.317711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-14a7d22d-1a59-4c53-8f8f-eac8e3ee2389 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.225836 May 17 22:13:01.327343 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 300/629] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:01 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:01.557780 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0d6bc2dd-d005-45fd-bc57-4d7244c912de tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:01.558376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0d6bc2dd-d005-45fd-bc57-4d7244c912de tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:01.564878 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0d6bc2dd-d005-45fd-bc57-4d7244c912de tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:01.565334 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0d6bc2dd-d005-45fd-bc57-4d7244c912de tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:01.566086 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0d6bc2dd-d005-45fd-bc57-4d7244c912de tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:01.566512 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0d6bc2dd-d005-45fd-bc57-4d7244c912de tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:01.694887 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0d6bc2dd-d005-45fd-bc57-4d7244c912de tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:01.702014 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0d6bc2dd-d005-45fd-bc57-4d7244c912de tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1504 microversion: 2.1 time: 0.148110 May 17 22:13:01.702572 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 330/630] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:01 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:01.770816 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9df5e1d9-434f-442b-b34e-b6773cf42d7b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:01.771473 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9df5e1d9-434f-442b-b34e-b6773cf42d7b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:01.777379 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9df5e1d9-434f-442b-b34e-b6773cf42d7b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:01.777828 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9df5e1d9-434f-442b-b34e-b6773cf42d7b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:01.778592 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9df5e1d9-434f-442b-b34e-b6773cf42d7b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:01.779025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9df5e1d9-434f-442b-b34e-b6773cf42d7b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:01.838444 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9df5e1d9-434f-442b-b34e-b6773cf42d7b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:01.845917 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9df5e1d9-434f-442b-b34e-b6773cf42d7b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1223 microversion: 2.1 time: 0.079148 May 17 22:13:01.846632 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 301/631] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:01 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:02.331414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6def6701-1bb5-480d-8443-44165586f1a7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:02.332014 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6def6701-1bb5-480d-8443-44165586f1a7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:02.334497 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4162d0b5-0612-4d49-ad34-1635cb0e6927 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:02.335101 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4162d0b5-0612-4d49-ad34-1635cb0e6927 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:02.337974 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6def6701-1bb5-480d-8443-44165586f1a7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:02.338495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6def6701-1bb5-480d-8443-44165586f1a7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:02.339286 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6def6701-1bb5-480d-8443-44165586f1a7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:02.339713 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6def6701-1bb5-480d-8443-44165586f1a7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:02.341498 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4162d0b5-0612-4d49-ad34-1635cb0e6927 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:02.341942 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4162d0b5-0612-4d49-ad34-1635cb0e6927 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:02.342715 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4162d0b5-0612-4d49-ad34-1635cb0e6927 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:02.344532 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4162d0b5-0612-4d49-ad34-1635cb0e6927 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:02.533436 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6def6701-1bb5-480d-8443-44165586f1a7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:02.536753 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4162d0b5-0612-4d49-ad34-1635cb0e6927 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:02.541959 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6def6701-1bb5-480d-8443-44165586f1a7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:02.543535 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6def6701-1bb5-480d-8443-44165586f1a7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:02.544022 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4162d0b5-0612-4d49-ad34-1635cb0e6927 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.213297 May 17 22:13:02.544601 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 302/632] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:02 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:02.544726 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6def6701-1bb5-480d-8443-44165586f1a7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.217493 May 17 22:13:02.545270 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 331/633] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:13:02 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:13:02.720572 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-68190849-40ce-4c53-b1a7-266aa8286dab tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:02.721184 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-68190849-40ce-4c53-b1a7-266aa8286dab tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:02.727206 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-68190849-40ce-4c53-b1a7-266aa8286dab tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:02.727657 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-68190849-40ce-4c53-b1a7-266aa8286dab tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:02.728447 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-68190849-40ce-4c53-b1a7-266aa8286dab tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:02.728885 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-68190849-40ce-4c53-b1a7-266aa8286dab tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:02.863011 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c7e322a2-2a77-4f92-b7c4-c78d6501b9c0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:02.864343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c7e322a2-2a77-4f92-b7c4-c78d6501b9c0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:02.871147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c7e322a2-2a77-4f92-b7c4-c78d6501b9c0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:02.871598 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c7e322a2-2a77-4f92-b7c4-c78d6501b9c0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:02.872592 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c7e322a2-2a77-4f92-b7c4-c78d6501b9c0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:02.873154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c7e322a2-2a77-4f92-b7c4-c78d6501b9c0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:02.915002 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-68190849-40ce-4c53-b1a7-266aa8286dab tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:02.923640 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-68190849-40ce-4c53-b1a7-266aa8286dab tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1504 microversion: 2.1 time: 0.207501 May 17 22:13:02.924434 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 303/634] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:02 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:02.972103 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c7e322a2-2a77-4f92-b7c4-c78d6501b9c0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:02.979609 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c7e322a2-2a77-4f92-b7c4-c78d6501b9c0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1271 microversion: 2.1 time: 0.120458 May 17 22:13:02.989592 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 332/635] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:02 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:03.231605 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-c889193b-9153-4993-9382-5a355a49e4cf req-4431a800-2cd2-48c2-ad25-01d4170b1a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf0a9fb-ace7-4487-9453-fa095718cfc8", "name": "network-vif-deleted", "tag": "b67e5a8d-71dd-4b27-94cf-bf13726c9536"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:03.244009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-c889193b-9153-4993-9382-5a355a49e4cf req-4431a800-2cd2-48c2-ad25-01d4170b1a28 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:03.244445 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-c889193b-9153-4993-9382-5a355a49e4cf req-4431a800-2cd2-48c2-ad25-01d4170b1a28 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:03.256080 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-c889193b-9153-4993-9382-5a355a49e4cf req-4431a800-2cd2-48c2-ad25-01d4170b1a28 service nova] Creating event network-vif-deleted:b67e5a8d-71dd-4b27-94cf-bf13726c9536 for instance 7bf0a9fb-ace7-4487-9453-fa095718cfc8 on hv-cinder-83998 May 17 22:13:03.260770 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-c889193b-9153-4993-9382-5a355a49e4cf req-4431a800-2cd2-48c2-ad25-01d4170b1a28 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033342 May 17 22:13:03.261337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 304/636] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:03.562311 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-72aaa461-0813-4499-88d0-1ca20d2356fa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:03.562963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-72aaa461-0813-4499-88d0-1ca20d2356fa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:03.567225 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fcdb758f-ecc5-437d-bda7-a86472141896 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:03.567932 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fcdb758f-ecc5-437d-bda7-a86472141896 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:03.569524 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72aaa461-0813-4499-88d0-1ca20d2356fa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:03.569993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72aaa461-0813-4499-88d0-1ca20d2356fa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:03.570782 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72aaa461-0813-4499-88d0-1ca20d2356fa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:03.571257 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-72aaa461-0813-4499-88d0-1ca20d2356fa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:03.576378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fcdb758f-ecc5-437d-bda7-a86472141896 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:03.576378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fcdb758f-ecc5-437d-bda7-a86472141896 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:03.581299 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fcdb758f-ecc5-437d-bda7-a86472141896 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:03.581798 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fcdb758f-ecc5-437d-bda7-a86472141896 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:04.015942 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-72aaa461-0813-4499-88d0-1ca20d2356fa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:04.020743 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fcdb758f-ecc5-437d-bda7-a86472141896 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:04.023398 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-72aaa461-0813-4499-88d0-1ca20d2356fa tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.465539 May 17 22:13:04.023973 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 333/637] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:03 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:04.040738 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fcdb758f-ecc5-437d-bda7-a86472141896 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:04.041990 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-52fcfd4c-673b-49a7-8e4d-bbe4b9387f05 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:04.046198 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fcdb758f-ecc5-437d-bda7-a86472141896 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:04.046330 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-52fcfd4c-673b-49a7-8e4d-bbe4b9387f05 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:04.046416 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fcdb758f-ecc5-437d-bda7-a86472141896 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1809 microversion: 2.20 time: 0.481959 May 17 22:13:04.046416 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 305/638] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:13:03 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1809 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:13:04.050023 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52fcfd4c-673b-49a7-8e4d-bbe4b9387f05 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:04.050175 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-208c7c1d-4c09-4429-b127-e33717c3b18a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:04.050452 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52fcfd4c-673b-49a7-8e4d-bbe4b9387f05 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:04.050776 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-208c7c1d-4c09-4429-b127-e33717c3b18a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:04.051249 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52fcfd4c-673b-49a7-8e4d-bbe4b9387f05 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:04.051920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52fcfd4c-673b-49a7-8e4d-bbe4b9387f05 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:04.056708 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-208c7c1d-4c09-4429-b127-e33717c3b18a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:04.057213 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-208c7c1d-4c09-4429-b127-e33717c3b18a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:04.058063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-208c7c1d-4c09-4429-b127-e33717c3b18a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:04.058502 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-208c7c1d-4c09-4429-b127-e33717c3b18a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:04.085961 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52fcfd4c-673b-49a7-8e4d-bbe4b9387f05 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:04.086543 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-52fcfd4c-673b-49a7-8e4d-bbe4b9387f05 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:04.086948 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-52fcfd4c-673b-49a7-8e4d-bbe4b9387f05 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lazy-loading 'fault' on Instance uuid 7bf0a9fb-ace7-4487-9453-fa095718cfc8 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:13:04.140204 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-208c7c1d-4c09-4429-b127-e33717c3b18a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:04.142677 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-52fcfd4c-673b-49a7-8e4d-bbe4b9387f05 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:04.147855 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-208c7c1d-4c09-4429-b127-e33717c3b18a tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1271 microversion: 2.1 time: 0.101819 May 17 22:13:04.148438 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 306/639] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:04 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:04.150505 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-52fcfd4c-673b-49a7-8e4d-bbe4b9387f05 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1304 microversion: 2.1 time: 0.125244 May 17 22:13:04.151282 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 334/640] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:04 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:05.042980 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9b50c8e9-a835-4d73-8075-bb322622c357 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:05.043632 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9b50c8e9-a835-4d73-8075-bb322622c357 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:05.050691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b50c8e9-a835-4d73-8075-bb322622c357 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:05.051178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b50c8e9-a835-4d73-8075-bb322622c357 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:05.051957 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b50c8e9-a835-4d73-8075-bb322622c357 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:05.052395 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b50c8e9-a835-4d73-8075-bb322622c357 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:05.063696 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3307a0d8-3a3c-4fac-9cf0-abe93513a8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:05.064864 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3307a0d8-3a3c-4fac-9cf0-abe93513a8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:05.071445 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3307a0d8-3a3c-4fac-9cf0-abe93513a8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:05.071895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3307a0d8-3a3c-4fac-9cf0-abe93513a8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:05.072672 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3307a0d8-3a3c-4fac-9cf0-abe93513a8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:05.073106 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3307a0d8-3a3c-4fac-9cf0-abe93513a8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:05.365823 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9b50c8e9-a835-4d73-8075-bb322622c357 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:05.367819 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3307a0d8-3a3c-4fac-9cf0-abe93513a8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:05.380850 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9b50c8e9-a835-4d73-8075-bb322622c357 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.341557 May 17 22:13:05.381452 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 307/641] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:05 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:05.383967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3307a0d8-3a3c-4fac-9cf0-abe93513a8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:05.386044 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3307a0d8-3a3c-4fac-9cf0-abe93513a8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:05.386861 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ae8e3741-ca93-4ca2-9aea-400399c1263b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:05.387683 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ae8e3741-ca93-4ca2-9aea-400399c1263b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:05.388181 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3307a0d8-3a3c-4fac-9cf0-abe93513a8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1796 microversion: 2.20 time: 0.328573 May 17 22:13:05.397678 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 335/642] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:13:05 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1796 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:13:05.404643 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6c0253f0-fe58-4c8d-a269-9e2d01ade101 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:05.405190 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae8e3741-ca93-4ca2-9aea-400399c1263b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:05.405329 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6c0253f0-fe58-4c8d-a269-9e2d01ade101 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:05.405972 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae8e3741-ca93-4ca2-9aea-400399c1263b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:05.408411 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae8e3741-ca93-4ca2-9aea-400399c1263b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:05.412863 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ae8e3741-ca93-4ca2-9aea-400399c1263b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:05.414328 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6c0253f0-fe58-4c8d-a269-9e2d01ade101 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:05.414328 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6c0253f0-fe58-4c8d-a269-9e2d01ade101 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:05.414328 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6c0253f0-fe58-4c8d-a269-9e2d01ade101 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:05.414328 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6c0253f0-fe58-4c8d-a269-9e2d01ade101 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:05.457785 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6c0253f0-fe58-4c8d-a269-9e2d01ade101 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:05.458476 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6c0253f0-fe58-4c8d-a269-9e2d01ade101 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:05.458930 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-6c0253f0-fe58-4c8d-a269-9e2d01ade101 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lazy-loading 'fault' on Instance uuid 7bf0a9fb-ace7-4487-9453-fa095718cfc8 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:13:05.520355 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ae8e3741-ca93-4ca2-9aea-400399c1263b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:05.528399 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ae8e3741-ca93-4ca2-9aea-400399c1263b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1289 microversion: 2.1 time: 0.145807 May 17 22:13:05.529135 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 308/643] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:05 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1289 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:05.541463 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6c0253f0-fe58-4c8d-a269-9e2d01ade101 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '091ee1085f2648649053108559390cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb417f91c56432a9f7d9ef7bcf528f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:05.549586 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6c0253f0-fe58-4c8d-a269-9e2d01ade101 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 200 len: 1304 microversion: 2.1 time: 0.159359 May 17 22:13:05.550172 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 336/644] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:05 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 1304 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:05.638494 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-801c32d8-4302-4bf6-a526-ae310e6b0d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:05.639532 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-801c32d8-4302-4bf6-a526-ae310e6b0d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:05.645517 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-801c32d8-4302-4bf6-a526-ae310e6b0d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:05.645970 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-801c32d8-4302-4bf6-a526-ae310e6b0d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:05.646759 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-801c32d8-4302-4bf6-a526-ae310e6b0d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:05.647219 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-801c32d8-4302-4bf6-a526-ae310e6b0d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:05.670128 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-801c32d8-4302-4bf6-a526-ae310e6b0d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lazy-loading 'flavor' on Instance uuid da3e521e-c843-4727-8c31-00c86e4e6aa0 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:13:05.991296 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-801c32d8-4302-4bf6-a526-ae310e6b0d73 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "POST /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/action" status: 200 len: 32 microversion: 2.1 time: 0.356614 May 17 22:13:05.991865 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 309/645] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:13:05 2022] POST /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/action => generated 32 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 22:13:06.007865 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-10c73963-32cd-4964-ae2a-58e0f982b1e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:06.008549 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-10c73963-32cd-4964-ae2a-58e0f982b1e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:06.018340 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10c73963-32cd-4964-ae2a-58e0f982b1e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:06.019496 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10c73963-32cd-4964-ae2a-58e0f982b1e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:06.021051 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10c73963-32cd-4964-ae2a-58e0f982b1e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:06.022032 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-10c73963-32cd-4964-ae2a-58e0f982b1e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:06.295613 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-10c73963-32cd-4964-ae2a-58e0f982b1e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:06.304862 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-10c73963-32cd-4964-ae2a-58e0f982b1e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.301095 May 17 22:13:06.305604 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 337/646] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:05 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:06.398833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1852811a-7fb6-4b57-9fd3-7dab3a37cc45 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:06.399563 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1852811a-7fb6-4b57-9fd3-7dab3a37cc45 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:06.406564 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1852811a-7fb6-4b57-9fd3-7dab3a37cc45 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:06.407017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1852811a-7fb6-4b57-9fd3-7dab3a37cc45 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:06.408324 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1852811a-7fb6-4b57-9fd3-7dab3a37cc45 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:06.408756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1852811a-7fb6-4b57-9fd3-7dab3a37cc45 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:06.545762 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9354ba0c-3084-4d39-9f7b-042b1a785d12 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:06.546528 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9354ba0c-3084-4d39-9f7b-042b1a785d12 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:06.554125 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9354ba0c-3084-4d39-9f7b-042b1a785d12 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:06.554568 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9354ba0c-3084-4d39-9f7b-042b1a785d12 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:06.555376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9354ba0c-3084-4d39-9f7b-042b1a785d12 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:06.555808 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9354ba0c-3084-4d39-9f7b-042b1a785d12 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:06.727812 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1852811a-7fb6-4b57-9fd3-7dab3a37cc45 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:06.735359 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1852811a-7fb6-4b57-9fd3-7dab3a37cc45 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.341206 May 17 22:13:06.736920 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 310/647] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:06 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:06.742016 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-92373abe-8bd4-4520-8df9-e5f62770db00 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:06.742692 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-92373abe-8bd4-4520-8df9-e5f62770db00 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] [instance: 7bf0a9fb-ace7-4487-9453-fa095718cfc8] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:06.748590 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-92373abe-8bd4-4520-8df9-e5f62770db00 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:06.749121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-92373abe-8bd4-4520-8df9-e5f62770db00 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:06.749899 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-92373abe-8bd4-4520-8df9-e5f62770db00 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:06.750337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-92373abe-8bd4-4520-8df9-e5f62770db00 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:06.764422 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-92373abe-8bd4-4520-8df9-e5f62770db00 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] HTTP exception thrown: Instance 7bf0a9fb-ace7-4487-9453-fa095718cfc8 could not be found. May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-92373abe-8bd4-4520-8df9-e5f62770db00 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Request method failure captured: May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 HTTP/1.1 May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB2p5dkNt1T4RKRBMyhtNVnM-J8PE07kt_vYJ5UChBVKwPhfw-hMhYmxpGf2oj_s9yA63TAD2RoE4SQ9p60316IWYodhcuKlkR8iBqvdTa5cw5LFZkqK-z9KNUmgSQtxTXDjHl-vWJqktoHYIakcNZDLn1-K2BEe8EncB8cqlNcAe38 May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 8cb417f91c56432a9f7d9ef7bcf528f9 May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-VolumesActionsTest-1081635847 May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:13:06.766112 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:13:06.767688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8cb417f91c56432a9f7d9ef7bcf528f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8cb417f91c56432a9f7d9ef7bcf528f9", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8cb417f91c56432a9f7d9ef7bcf528f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8cb417f91c56432a9f7d9ef7bcf528f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:13:06.767688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-VolumesActionsTest-1081635847 May 17 22:13:06.767688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 8cb417f91c56432a9f7d9ef7bcf528f9 May 17 22:13:06.767688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-VolumesActionsTest-1081635847 May 17 22:13:06.767688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-VolumesActionsTest-1081635847-project May 17 22:13:06.767688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:13:06.767688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:13:06.767688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 091ee1085f2648649053108559390cd1 May 17 22:13:06.767688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-VolumesActionsTest-1081635847-project May 17 22:13:06.767688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:13:06.767688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 7bf0a9fb-ace7-4487-9453-fa095718cfc8 could not be found. May 17 22:13:06.767688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '7bf0a9fb-ace7-4487-9453-fa095718cfc8'} May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf0a9fb-ace7-4487-9453-fa095718cfc8 could not be found. May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:13:06.768612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf0a9fb-ace7-4487-9453-fa095718cfc8 could not be found. May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf0a9fb-ace7-4487-9453-fa095718cfc8 could not be found. May 17 22:13:06.769974 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:06.771053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-92373abe-8bd4-4520-8df9-e5f62770db00 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] Returning 404 to user: Instance 7bf0a9fb-ace7-4487-9453-fa095718cfc8 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:13:06.771053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-92373abe-8bd4-4520-8df9-e5f62770db00 tempest-VolumesActionsTest-1081635847 tempest-VolumesActionsTest-1081635847-project] 10.222.0.24 "GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8" status: 404 len: 111 microversion: 2.1 time: 0.029764 May 17 22:13:06.771518 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 311/648] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:06 2022] GET /compute/v2.1/servers/7bf0a9fb-ace7-4487-9453-fa095718cfc8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:13:06.940728 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9354ba0c-3084-4d39-9f7b-042b1a785d12 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:06.951700 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9354ba0c-3084-4d39-9f7b-042b1a785d12 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1319 microversion: 2.1 time: 0.409765 May 17 22:13:06.952297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 338/649] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:06 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:07.331838 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b8c9194a-c066-4842-a813-964cd5dade29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:07.332819 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b8c9194a-c066-4842-a813-964cd5dade29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:07.340791 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8c9194a-c066-4842-a813-964cd5dade29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:07.340791 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8c9194a-c066-4842-a813-964cd5dade29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:07.340791 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8c9194a-c066-4842-a813-964cd5dade29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:07.340791 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8c9194a-c066-4842-a813-964cd5dade29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:07.492639 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b8c9194a-c066-4842-a813-964cd5dade29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:07.500485 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b8c9194a-c066-4842-a813-964cd5dade29 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.173547 May 17 22:13:07.501116 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 312/650] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:07 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:07.570109 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-fa8df3ea-1a79-4908-80d6-8cd320a79bdd req-0cc01684-3896-44a0-8e71-7537c49e2e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91ceec7-4d65-407e-b85f-da561fe693a2", "tag": "c018dbd8-fb54-4a5e-a5b1-3aa16ddebbc8"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:07.578894 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-fa8df3ea-1a79-4908-80d6-8cd320a79bdd req-0cc01684-3896-44a0-8e71-7537c49e2e05 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:07.580022 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-fa8df3ea-1a79-4908-80d6-8cd320a79bdd req-0cc01684-3896-44a0-8e71-7537c49e2e05 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:07.592471 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-fa8df3ea-1a79-4908-80d6-8cd320a79bdd req-0cc01684-3896-44a0-8e71-7537c49e2e05 service nova] Creating event network-changed:c018dbd8-fb54-4a5e-a5b1-3aa16ddebbc8 for instance b91ceec7-4d65-407e-b85f-da561fe693a2 on hv-cinder-83998 May 17 22:13:07.598301 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-fa8df3ea-1a79-4908-80d6-8cd320a79bdd req-0cc01684-3896-44a0-8e71-7537c49e2e05 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031722 May 17 22:13:07.598870 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 339/651] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:07.754052 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-34712b63-3ac4-4213-bce8-3124edc0306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:07.757524 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-34712b63-3ac4-4213-bce8-3124edc0306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:07.760852 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34712b63-3ac4-4213-bce8-3124edc0306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:07.761397 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34712b63-3ac4-4213-bce8-3124edc0306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:07.762239 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34712b63-3ac4-4213-bce8-3124edc0306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:07.762895 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34712b63-3ac4-4213-bce8-3124edc0306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:07.963685 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-34712b63-3ac4-4213-bce8-3124edc0306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:07.968750 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-44442491-fe38-4f99-a006-d12f72e1a969 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:07.969457 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-44442491-fe38-4f99-a006-d12f72e1a969 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:07.972677 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-34712b63-3ac4-4213-bce8-3124edc0306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.222877 May 17 22:13:07.973444 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 313/652] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:07 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:07.977920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-44442491-fe38-4f99-a006-d12f72e1a969 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:07.977920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-44442491-fe38-4f99-a006-d12f72e1a969 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:07.977920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-44442491-fe38-4f99-a006-d12f72e1a969 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:07.978231 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-44442491-fe38-4f99-a006-d12f72e1a969 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:08.183264 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-44442491-fe38-4f99-a006-d12f72e1a969 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:08.190935 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-44442491-fe38-4f99-a006-d12f72e1a969 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1319 microversion: 2.1 time: 0.226691 May 17 22:13:08.191529 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 340/653] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:07 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:08.517562 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-df240bd7-11b1-480b-bd05-33d8e09e3bf5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:08.518106 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-df240bd7-11b1-480b-bd05-33d8e09e3bf5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:08.524333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df240bd7-11b1-480b-bd05-33d8e09e3bf5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:08.524774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df240bd7-11b1-480b-bd05-33d8e09e3bf5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:08.525520 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df240bd7-11b1-480b-bd05-33d8e09e3bf5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:08.525946 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df240bd7-11b1-480b-bd05-33d8e09e3bf5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:08.654561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-df240bd7-11b1-480b-bd05-33d8e09e3bf5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:08.663368 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-df240bd7-11b1-480b-bd05-33d8e09e3bf5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.150224 May 17 22:13:08.663932 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 314/654] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:08 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:08.989842 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a921f716-0fc0-422c-9d62-4a191fd70fe1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:08.990431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a921f716-0fc0-422c-9d62-4a191fd70fe1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:08.996834 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a921f716-0fc0-422c-9d62-4a191fd70fe1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:08.998747 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a921f716-0fc0-422c-9d62-4a191fd70fe1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:08.998747 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a921f716-0fc0-422c-9d62-4a191fd70fe1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:08.998747 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a921f716-0fc0-422c-9d62-4a191fd70fe1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.107515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-54a34743-b9b4-493c-af0d-3ba0d7faeda6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:09.108007 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-54a34743-b9b4-493c-af0d-3ba0d7faeda6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:09.113792 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54a34743-b9b4-493c-af0d-3ba0d7faeda6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:09.114238 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54a34743-b9b4-493c-af0d-3ba0d7faeda6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.114998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54a34743-b9b4-493c-af0d-3ba0d7faeda6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:09.115452 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-54a34743-b9b4-493c-af0d-3ba0d7faeda6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.128336 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a921f716-0fc0-422c-9d62-4a191fd70fe1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:09.136061 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a921f716-0fc0-422c-9d62-4a191fd70fe1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.149977 May 17 22:13:09.136639 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 341/655] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:08 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:09.137921 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-54a34743-b9b4-493c-af0d-3ba0d7faeda6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca/ips" status: 200 len: 150 microversion: 2.1 time: 0.034256 May 17 22:13:09.143154 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 315/656] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 17 22:13:09 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca/ips => generated 150 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:13:09.150046 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef75943b-d3c6-4e5c-9605-e185bdaf63ed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99dfd24f-271d-4bfb-a06b-1cc0830b14b1"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:09.151146 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ef75943b-d3c6-4e5c-9605-e185bdaf63ed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:09.157108 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef75943b-d3c6-4e5c-9605-e185bdaf63ed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:09.158128 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef75943b-d3c6-4e5c-9605-e185bdaf63ed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.158896 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef75943b-d3c6-4e5c-9605-e185bdaf63ed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:09.159355 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ef75943b-d3c6-4e5c-9605-e185bdaf63ed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.207871 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b35900b3-9620-48a2-b376-a2c88877e266 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:09.208471 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b35900b3-9620-48a2-b376-a2c88877e266 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:09.214131 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b35900b3-9620-48a2-b376-a2c88877e266 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:09.214568 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b35900b3-9620-48a2-b376-a2c88877e266 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.215419 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b35900b3-9620-48a2-b376-a2c88877e266 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:09.215863 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b35900b3-9620-48a2-b376-a2c88877e266 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.235886 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-ef75943b-d3c6-4e5c-9605-e185bdaf63ed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Invalid volume: volume 99dfd24f-271d-4bfb-a06b-1cc0830b14b1 is already attached to instances: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef75943b-d3c6-4e5c-9605-e185bdaf63ed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: POST /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca/os-volume_attachments HTTP/1.1 May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 74 May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:13:09.237606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:13:09.239152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:13:09.239152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:13:09.239152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:13:09.239152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:13:09.239152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:13:09.239152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:13:09.239152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:13:09.239152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:13:09.239152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:13:09.239152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: May 17 22:13:09.239152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {"volumeAttachment": {"volumeId": "99dfd24f-271d-4bfb-a06b-1cc0830b14b1"}} May 17 22:13:09.239152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Invalid volume: volume 99dfd24f-271d-4bfb-a06b-1cc0830b14b1 is already attached to instances: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'server_id': '429a5e1d-02ff-43b5-a293-584d721f62ca', 'body': {'volumeAttachment': {'volumeId': '99dfd24f-271d-4bfb-a06b-1cc0830b14b1'}}} May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 99dfd24f-271d-4bfb-a06b-1cc0830b14b1 is already attached to instances: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:13:09.239962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 99dfd24f-271d-4bfb-a06b-1cc0830b14b1 is already attached to instances: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:09.241154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:13:09.242316 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:13:09.242316 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:13:09.242316 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:13:09.242316 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 99dfd24f-271d-4bfb-a06b-1cc0830b14b1 is already attached to instances: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 May 17 22:13:09.242316 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:13:09.242316 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ef75943b-d3c6-4e5c-9605-e185bdaf63ed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 400 to user: Invalid volume: volume 99dfd24f-271d-4bfb-a06b-1cc0830b14b1 is already attached to instances: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:13:09.242316 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ef75943b-d3c6-4e5c-9605-e185bdaf63ed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092895 May 17 22:13:09.242316 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 342/657] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:13:09 2022] POST /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 22:13:09.247523 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3b63902a-9a80-4cd8-90cf-34ee68f67ad4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:09.248020 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3b63902a-9a80-4cd8-90cf-34ee68f67ad4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:09.257908 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b63902a-9a80-4cd8-90cf-34ee68f67ad4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:09.257908 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b63902a-9a80-4cd8-90cf-34ee68f67ad4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.257908 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b63902a-9a80-4cd8-90cf-34ee68f67ad4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:09.257908 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b63902a-9a80-4cd8-90cf-34ee68f67ad4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.282189 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3b63902a-9a80-4cd8-90cf-34ee68f67ad4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:13:09.343039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b35900b3-9620-48a2-b376-a2c88877e266 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:09.350276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b35900b3-9620-48a2-b376-a2c88877e266 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1319 microversion: 2.1 time: 0.146989 May 17 22:13:09.350843 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 316/658] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:09 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:09.542952 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3b63902a-9a80-4cd8-90cf-34ee68f67ad4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 204 len: 0 microversion: 2.1 time: 0.298738 May 17 22:13:09.543571 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 343/659] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:13:09 2022] DELETE /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:13:09.552259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-029aff1a-b2f6-4b73-8e76-adffaf2a15c7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:09.552873 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-029aff1a-b2f6-4b73-8e76-adffaf2a15c7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:09.559251 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-029aff1a-b2f6-4b73-8e76-adffaf2a15c7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:09.559704 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-029aff1a-b2f6-4b73-8e76-adffaf2a15c7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.560740 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-029aff1a-b2f6-4b73-8e76-adffaf2a15c7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:09.561178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-029aff1a-b2f6-4b73-8e76-adffaf2a15c7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.681598 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a2ad0dac-96f7-4066-a9bb-691f07d36cb1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:09.682320 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a2ad0dac-96f7-4066-a9bb-691f07d36cb1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:09.688420 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2ad0dac-96f7-4066-a9bb-691f07d36cb1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:09.688592 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-029aff1a-b2f6-4b73-8e76-adffaf2a15c7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:09.689507 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2ad0dac-96f7-4066-a9bb-691f07d36cb1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.690278 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2ad0dac-96f7-4066-a9bb-691f07d36cb1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:09.690706 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2ad0dac-96f7-4066-a9bb-691f07d36cb1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:09.698786 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-029aff1a-b2f6-4b73-8e76-adffaf2a15c7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1680 microversion: 2.1 time: 0.150829 May 17 22:13:09.699402 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 317/660] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:09 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:09.820415 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a2ad0dac-96f7-4066-a9bb-691f07d36cb1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:09.828219 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a2ad0dac-96f7-4066-a9bb-691f07d36cb1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.150863 May 17 22:13:09.828778 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 344/661] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:09 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:10.153620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a3e0d85a-020c-45b0-857c-716b18f1dadf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:10.154221 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a3e0d85a-020c-45b0-857c-716b18f1dadf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:10.161279 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3e0d85a-020c-45b0-857c-716b18f1dadf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:10.161724 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3e0d85a-020c-45b0-857c-716b18f1dadf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:10.162477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3e0d85a-020c-45b0-857c-716b18f1dadf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:10.162907 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3e0d85a-020c-45b0-857c-716b18f1dadf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:10.288137 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a3e0d85a-020c-45b0-857c-716b18f1dadf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:10.295646 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a3e0d85a-020c-45b0-857c-716b18f1dadf tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1678 microversion: 2.1 time: 0.145678 May 17 22:13:10.296232 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 318/662] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:10 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:10.367398 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9d78fc5a-84e5-4691-99c9-1a37fe4851c8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:10.368696 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9d78fc5a-84e5-4691-99c9-1a37fe4851c8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:10.375572 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d78fc5a-84e5-4691-99c9-1a37fe4851c8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:10.376263 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d78fc5a-84e5-4691-99c9-1a37fe4851c8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:10.377152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d78fc5a-84e5-4691-99c9-1a37fe4851c8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:10.377681 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d78fc5a-84e5-4691-99c9-1a37fe4851c8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:10.511577 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9d78fc5a-84e5-4691-99c9-1a37fe4851c8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:10.520899 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9d78fc5a-84e5-4691-99c9-1a37fe4851c8 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1319 microversion: 2.1 time: 0.157549 May 17 22:13:10.523154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 345/663] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:10 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:10.716687 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cb3c633f-63f7-4731-88b9-049f099502a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:10.717223 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cb3c633f-63f7-4731-88b9-049f099502a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:10.724146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cb3c633f-63f7-4731-88b9-049f099502a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:10.724615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cb3c633f-63f7-4731-88b9-049f099502a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:10.725380 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cb3c633f-63f7-4731-88b9-049f099502a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:10.725818 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cb3c633f-63f7-4731-88b9-049f099502a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:10.845930 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f0e937c0-b960-46d2-b403-5c9952658f08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:10.846617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f0e937c0-b960-46d2-b403-5c9952658f08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:10.850687 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cb3c633f-63f7-4731-88b9-049f099502a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:10.852550 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0e937c0-b960-46d2-b403-5c9952658f08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:10.853000 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0e937c0-b960-46d2-b403-5c9952658f08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:10.853773 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0e937c0-b960-46d2-b403-5c9952658f08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:10.854206 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0e937c0-b960-46d2-b403-5c9952658f08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:10.858203 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cb3c633f-63f7-4731-88b9-049f099502a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1680 microversion: 2.1 time: 0.145453 May 17 22:13:10.858768 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 319/664] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:10 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:10.981128 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f0e937c0-b960-46d2-b403-5c9952658f08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:10.989014 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f0e937c0-b960-46d2-b403-5c9952658f08 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.147842 May 17 22:13:10.989576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 346/665] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:10 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:11.314867 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-512deaaa-d81e-4b6d-9dc0-b32e07c94775 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:11.315498 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-512deaaa-d81e-4b6d-9dc0-b32e07c94775 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:11.321229 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-512deaaa-d81e-4b6d-9dc0-b32e07c94775 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:11.321668 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-512deaaa-d81e-4b6d-9dc0-b32e07c94775 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:11.322428 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-512deaaa-d81e-4b6d-9dc0-b32e07c94775 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:11.322856 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-512deaaa-d81e-4b6d-9dc0-b32e07c94775 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:11.449191 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-512deaaa-d81e-4b6d-9dc0-b32e07c94775 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:11.456603 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-512deaaa-d81e-4b6d-9dc0-b32e07c94775 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1655 microversion: 2.1 time: 0.146946 May 17 22:13:11.457175 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 320/666] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:11 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:11.473161 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c3364a13-fabd-40a5-a098-6a70d4d43d33 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:11.479424 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c3364a13-fabd-40a5-a098-6a70d4d43d33 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:11.479920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c3364a13-fabd-40a5-a098-6a70d4d43d33 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:11.501656 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c3364a13-fabd-40a5-a098-6a70d4d43d33 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Going to try to start instance {{(pid=117593) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 22:13:11.538126 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f3bcd041-f041-44c9-a585-bbd31a601ffd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:11.542121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f3bcd041-f041-44c9-a585-bbd31a601ffd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:11.544454 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f3bcd041-f041-44c9-a585-bbd31a601ffd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:11.544900 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f3bcd041-f041-44c9-a585-bbd31a601ffd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:11.545657 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f3bcd041-f041-44c9-a585-bbd31a601ffd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:11.546090 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f3bcd041-f041-44c9-a585-bbd31a601ffd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:11.657918 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c3364a13-fabd-40a5-a098-6a70d4d43d33 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "POST /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/action" status: 202 len: 0 microversion: 2.1 time: 0.188281 May 17 22:13:11.658693 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 347/667] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:13:11 2022] POST /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:13:11.667069 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3406db33-38fd-4613-9496-cd8a77ebc1ba tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:11.667782 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3406db33-38fd-4613-9496-cd8a77ebc1ba tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:11.674834 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3406db33-38fd-4613-9496-cd8a77ebc1ba tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:11.674973 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f3bcd041-f041-44c9-a585-bbd31a601ffd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:11.675321 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3406db33-38fd-4613-9496-cd8a77ebc1ba tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:11.676125 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3406db33-38fd-4613-9496-cd8a77ebc1ba tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:11.676564 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3406db33-38fd-4613-9496-cd8a77ebc1ba tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:11.682224 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f3bcd041-f041-44c9-a585-bbd31a601ffd tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1319 microversion: 2.1 time: 0.147896 May 17 22:13:11.682791 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 321/668] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:11 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:11.801647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3406db33-38fd-4613-9496-cd8a77ebc1ba tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:11.808919 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3406db33-38fd-4613-9496-cd8a77ebc1ba tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1664 microversion: 2.1 time: 0.145826 May 17 22:13:11.809492 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 348/669] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:11 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1664 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:11.876620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7a9d93fd-8810-4798-90e6-4f675ad1242d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:11.877156 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7a9d93fd-8810-4798-90e6-4f675ad1242d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:11.883517 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a9d93fd-8810-4798-90e6-4f675ad1242d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:11.883965 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a9d93fd-8810-4798-90e6-4f675ad1242d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:11.884728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a9d93fd-8810-4798-90e6-4f675ad1242d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:11.885156 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7a9d93fd-8810-4798-90e6-4f675ad1242d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:12.006395 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7d88d2b3-ae27-4dbf-9cbb-7b19946f8032 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:12.006996 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7d88d2b3-ae27-4dbf-9cbb-7b19946f8032 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:12.012752 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d88d2b3-ae27-4dbf-9cbb-7b19946f8032 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:12.013195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d88d2b3-ae27-4dbf-9cbb-7b19946f8032 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:12.013953 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d88d2b3-ae27-4dbf-9cbb-7b19946f8032 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:12.014380 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d88d2b3-ae27-4dbf-9cbb-7b19946f8032 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:12.019009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7a9d93fd-8810-4798-90e6-4f675ad1242d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:12.026208 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7a9d93fd-8810-4798-90e6-4f675ad1242d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1680 microversion: 2.1 time: 0.153831 May 17 22:13:12.026770 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 322/670] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:11 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:12.140508 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7d88d2b3-ae27-4dbf-9cbb-7b19946f8032 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:12.153571 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7d88d2b3-ae27-4dbf-9cbb-7b19946f8032 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.150532 May 17 22:13:12.155459 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 349/671] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:12 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:12.541881 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-469399b6-8586-43d4-9163-47695beb7719 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:12.542893 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-469399b6-8586-43d4-9163-47695beb7719 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:12.550859 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-469399b6-8586-43d4-9163-47695beb7719 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:12.551499 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-469399b6-8586-43d4-9163-47695beb7719 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:12.552566 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-469399b6-8586-43d4-9163-47695beb7719 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:12.553212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-469399b6-8586-43d4-9163-47695beb7719 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:12.702777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b5b115d9-d1d4-4b2c-9691-039256c70aa0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:12.703778 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b5b115d9-d1d4-4b2c-9691-039256c70aa0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:12.717139 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5b115d9-d1d4-4b2c-9691-039256c70aa0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:12.718713 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5b115d9-d1d4-4b2c-9691-039256c70aa0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:12.720708 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5b115d9-d1d4-4b2c-9691-039256c70aa0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:12.721869 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5b115d9-d1d4-4b2c-9691-039256c70aa0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:12.762403 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-469399b6-8586-43d4-9163-47695beb7719 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "POST /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/action" status: 202 len: 0 microversion: 2.1 time: 0.224043 May 17 22:13:12.763704 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 323/672] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:13:12 2022] POST /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:13:12.772359 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7abeb620-ae60-4adf-b4de-ab7c44cdd14a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:12.773345 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7abeb620-ae60-4adf-b4de-ab7c44cdd14a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:12.781535 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7abeb620-ae60-4adf-b4de-ab7c44cdd14a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:12.782663 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7abeb620-ae60-4adf-b4de-ab7c44cdd14a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:12.783199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7abeb620-ae60-4adf-b4de-ab7c44cdd14a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:12.783690 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7abeb620-ae60-4adf-b4de-ab7c44cdd14a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:12.988481 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b5b115d9-d1d4-4b2c-9691-039256c70aa0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:12.997555 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b5b115d9-d1d4-4b2c-9691-039256c70aa0 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1319 microversion: 2.1 time: 0.301672 May 17 22:13:12.998451 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 350/673] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:12 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:13.004315 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-af8f9bf2-a658-4b63-a427-90a133c44f7c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:13.004833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-af8f9bf2-a658-4b63-a427-90a133c44f7c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:13.011566 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-af8f9bf2-a658-4b63-a427-90a133c44f7c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:13.012024 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-af8f9bf2-a658-4b63-a427-90a133c44f7c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:13.012978 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-af8f9bf2-a658-4b63-a427-90a133c44f7c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:13.013415 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-af8f9bf2-a658-4b63-a427-90a133c44f7c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:13.042934 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7abeb620-ae60-4adf-b4de-ab7c44cdd14a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:13.062420 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7abeb620-ae60-4adf-b4de-ab7c44cdd14a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1751 microversion: 2.1 time: 0.293647 May 17 22:13:13.064995 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 324/674] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:12 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1751 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:13.077295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-471a4ef6-7bf4-4516-8dbd-ca9a337f4c78 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:13.078587 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-471a4ef6-7bf4-4516-8dbd-ca9a337f4c78 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:13.090350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-471a4ef6-7bf4-4516-8dbd-ca9a337f4c78 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:13.091217 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-471a4ef6-7bf4-4516-8dbd-ca9a337f4c78 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:13.093467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-471a4ef6-7bf4-4516-8dbd-ca9a337f4c78 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:13.094083 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-471a4ef6-7bf4-4516-8dbd-ca9a337f4c78 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:13.195701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-af8f9bf2-a658-4b63-a427-90a133c44f7c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:13.206962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-af8f9bf2-a658-4b63-a427-90a133c44f7c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1664 microversion: 2.1 time: 0.207342 May 17 22:13:13.207593 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 351/675] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:12 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1664 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:13.213737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-970ab781-366d-403e-8619-f52c16ef0cea tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:13.214344 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-970ab781-366d-403e-8619-f52c16ef0cea tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:13.221547 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-970ab781-366d-403e-8619-f52c16ef0cea tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:13.221993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-970ab781-366d-403e-8619-f52c16ef0cea tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:13.222973 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-970ab781-366d-403e-8619-f52c16ef0cea tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:13.223438 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-970ab781-366d-403e-8619-f52c16ef0cea tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:13.333453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-471a4ef6-7bf4-4516-8dbd-ca9a337f4c78 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:13.341488 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-471a4ef6-7bf4-4516-8dbd-ca9a337f4c78 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1680 microversion: 2.1 time: 0.275286 May 17 22:13:13.343729 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 325/676] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:13 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1680 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:13.404849 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-970ab781-366d-403e-8619-f52c16ef0cea tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:13.427390 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-970ab781-366d-403e-8619-f52c16ef0cea tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.205372 May 17 22:13:13.427390 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 352/677] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:13 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:14.013876 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0cb9bf69-50f5-4a2b-b6ec-768a3ffdee37 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:14.014880 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0cb9bf69-50f5-4a2b-b6ec-768a3ffdee37 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:14.024532 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0cb9bf69-50f5-4a2b-b6ec-768a3ffdee37 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:14.025961 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0cb9bf69-50f5-4a2b-b6ec-768a3ffdee37 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:14.028019 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0cb9bf69-50f5-4a2b-b6ec-768a3ffdee37 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:14.028671 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0cb9bf69-50f5-4a2b-b6ec-768a3ffdee37 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:14.081974 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fb6a2eca-4bc1-4bb4-b131-372821cc979b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:14.082578 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fb6a2eca-4bc1-4bb4-b131-372821cc979b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:14.101586 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fb6a2eca-4bc1-4bb4-b131-372821cc979b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:14.102325 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fb6a2eca-4bc1-4bb4-b131-372821cc979b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:14.103308 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fb6a2eca-4bc1-4bb4-b131-372821cc979b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:14.103920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fb6a2eca-4bc1-4bb4-b131-372821cc979b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:14.449185 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0cb9bf69-50f5-4a2b-b6ec-768a3ffdee37 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:14.460818 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0cb9bf69-50f5-4a2b-b6ec-768a3ffdee37 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1319 microversion: 2.1 time: 0.448753 May 17 22:13:14.471648 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 326/678] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:14 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:14.482247 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2f2fb523-7f31-4354-901d-ca2232a97965 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:14.493763 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2f2fb523-7f31-4354-901d-ca2232a97965 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:14.499926 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2f2fb523-7f31-4354-901d-ca2232a97965 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:14.500481 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2f2fb523-7f31-4354-901d-ca2232a97965 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:14.501653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2f2fb523-7f31-4354-901d-ca2232a97965 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:14.502220 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2f2fb523-7f31-4354-901d-ca2232a97965 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:14.628005 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fb6a2eca-4bc1-4bb4-b131-372821cc979b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:14.640333 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fb6a2eca-4bc1-4bb4-b131-372821cc979b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1751 microversion: 2.1 time: 0.561689 May 17 22:13:14.641291 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 353/679] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:14 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1751 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:14.655760 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e826ebc2-09c9-48de-944d-086c7b3689e4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:14.656594 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e826ebc2-09c9-48de-944d-086c7b3689e4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:14.669670 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e826ebc2-09c9-48de-944d-086c7b3689e4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:14.670777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e826ebc2-09c9-48de-944d-086c7b3689e4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:14.671827 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e826ebc2-09c9-48de-944d-086c7b3689e4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:14.672398 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e826ebc2-09c9-48de-944d-086c7b3689e4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:15.021188 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2f2fb523-7f31-4354-901d-ca2232a97965 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:15.044295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2f2fb523-7f31-4354-901d-ca2232a97965 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1664 microversion: 2.1 time: 0.572594 May 17 22:13:15.045595 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 327/680] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:14 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1664 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:15.050436 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-898fd5ac-0b75-4c08-9c40-209f560a0597 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:15.051324 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-898fd5ac-0b75-4c08-9c40-209f560a0597 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:15.058538 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-898fd5ac-0b75-4c08-9c40-209f560a0597 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:15.058989 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-898fd5ac-0b75-4c08-9c40-209f560a0597 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:15.059914 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-898fd5ac-0b75-4c08-9c40-209f560a0597 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:15.060608 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-898fd5ac-0b75-4c08-9c40-209f560a0597 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:15.207834 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e826ebc2-09c9-48de-944d-086c7b3689e4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:15.217241 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e826ebc2-09c9-48de-944d-086c7b3689e4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1680 microversion: 2.1 time: 0.570359 May 17 22:13:15.218035 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 354/681] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:14 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1680 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:15.424127 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-898fd5ac-0b75-4c08-9c40-209f560a0597 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:15.437120 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-898fd5ac-0b75-4c08-9c40-209f560a0597 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.390109 May 17 22:13:15.437823 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 328/682] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:15 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:15.478141 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-30b4231d-028a-4c2a-81f3-964deed33dad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:15.479191 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-30b4231d-028a-4c2a-81f3-964deed33dad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:15.485380 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-30b4231d-028a-4c2a-81f3-964deed33dad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:15.486038 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-30b4231d-028a-4c2a-81f3-964deed33dad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:15.487061 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-30b4231d-028a-4c2a-81f3-964deed33dad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:15.487841 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-30b4231d-028a-4c2a-81f3-964deed33dad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:15.634380 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-30b4231d-028a-4c2a-81f3-964deed33dad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:15.643730 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-30b4231d-028a-4c2a-81f3-964deed33dad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1319 microversion: 2.1 time: 0.169399 May 17 22:13:15.706164 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 355/683] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:15 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:15.706348 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-29ff94f0-60b1-4e80-a976-fdb9b719a75a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:15.706348 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-29ff94f0-60b1-4e80-a976-fdb9b719a75a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:15.706348 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-29ff94f0-60b1-4e80-a976-fdb9b719a75a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:15.706348 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-29ff94f0-60b1-4e80-a976-fdb9b719a75a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:15.707068 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-29ff94f0-60b1-4e80-a976-fdb9b719a75a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:15.707068 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-29ff94f0-60b1-4e80-a976-fdb9b719a75a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:15.898211 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-29ff94f0-60b1-4e80-a976-fdb9b719a75a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:15.914998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-29ff94f0-60b1-4e80-a976-fdb9b719a75a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.255651 May 17 22:13:15.919945 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 329/684] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:15 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:16.062655 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b5d8895a-48c5-402d-a23f-4e829ce9a79e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:16.065362 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b5d8895a-48c5-402d-a23f-4e829ce9a79e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:16.073051 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5d8895a-48c5-402d-a23f-4e829ce9a79e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:16.074122 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5d8895a-48c5-402d-a23f-4e829ce9a79e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:16.075356 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5d8895a-48c5-402d-a23f-4e829ce9a79e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:16.076610 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b5d8895a-48c5-402d-a23f-4e829ce9a79e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:16.237671 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b796b1ee-2308-4ef1-982d-dc3a546c3c67 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:16.238810 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b796b1ee-2308-4ef1-982d-dc3a546c3c67 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:16.253147 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b796b1ee-2308-4ef1-982d-dc3a546c3c67 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:16.253850 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b796b1ee-2308-4ef1-982d-dc3a546c3c67 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:16.261265 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b796b1ee-2308-4ef1-982d-dc3a546c3c67 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:16.262593 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b796b1ee-2308-4ef1-982d-dc3a546c3c67 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:16.369992 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b796b1ee-2308-4ef1-982d-dc3a546c3c67 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:16.379171 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b5d8895a-48c5-402d-a23f-4e829ce9a79e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:16.379738 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b796b1ee-2308-4ef1-982d-dc3a546c3c67 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1614 microversion: 2.1 time: 0.146517 May 17 22:13:16.380530 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 330/685] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:16 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1614 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:16.385831 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-4b921733-fe42-4cf9-b086-ca31bb1a14c2 req-f4548dae-f011-4c93-b61f-d78035e13881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429a5e1d-02ff-43b5-a293-584d721f62ca", "name": "network-vif-deleted", "tag": "b2ca1063-f162-4839-8103-868d1a01da49"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:16.395304 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-4b921733-fe42-4cf9-b086-ca31bb1a14c2 req-f4548dae-f011-4c93-b61f-d78035e13881 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:16.396227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-4b921733-fe42-4cf9-b086-ca31bb1a14c2 req-f4548dae-f011-4c93-b61f-d78035e13881 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:16.397032 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b5d8895a-48c5-402d-a23f-4e829ce9a79e tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1664 microversion: 2.1 time: 0.338676 May 17 22:13:16.397940 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 356/686] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:16 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1664 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:16.409419 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-4b921733-fe42-4cf9-b086-ca31bb1a14c2 req-f4548dae-f011-4c93-b61f-d78035e13881 service nova] Creating event network-vif-deleted:b2ca1063-f162-4839-8103-868d1a01da49 for instance 429a5e1d-02ff-43b5-a293-584d721f62ca on hv-cinder-83998 May 17 22:13:16.414960 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-4b921733-fe42-4cf9-b086-ca31bb1a14c2 req-f4548dae-f011-4c93-b61f-d78035e13881 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032729 May 17 22:13:16.422776 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 331/687] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:16.455469 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-27ddc205-74a9-490d-b853-4a6463515582 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:16.456888 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-27ddc205-74a9-490d-b853-4a6463515582 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:16.468631 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-27ddc205-74a9-490d-b853-4a6463515582 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:16.469295 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-27ddc205-74a9-490d-b853-4a6463515582 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:16.470867 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-27ddc205-74a9-490d-b853-4a6463515582 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:16.471497 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-27ddc205-74a9-490d-b853-4a6463515582 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:16.662324 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cfc808f4-f7ac-4b44-826f-cc12ae85d956 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:16.663182 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cfc808f4-f7ac-4b44-826f-cc12ae85d956 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:16.674521 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cfc808f4-f7ac-4b44-826f-cc12ae85d956 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:16.675051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cfc808f4-f7ac-4b44-826f-cc12ae85d956 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:16.675888 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cfc808f4-f7ac-4b44-826f-cc12ae85d956 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:16.676398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cfc808f4-f7ac-4b44-826f-cc12ae85d956 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:16.711017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-27ddc205-74a9-490d-b853-4a6463515582 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:16.724211 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-27ddc205-74a9-490d-b853-4a6463515582 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.273149 May 17 22:13:16.731934 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 357/688] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:16 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:16.937314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9d93e4c9-0c3f-4cb1-b373-a6d54c55fa1a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:16.940694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9d93e4c9-0c3f-4cb1-b373-a6d54c55fa1a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:16.952931 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d93e4c9-0c3f-4cb1-b373-a6d54c55fa1a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:16.953394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d93e4c9-0c3f-4cb1-b373-a6d54c55fa1a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:16.955775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d93e4c9-0c3f-4cb1-b373-a6d54c55fa1a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:16.957091 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d93e4c9-0c3f-4cb1-b373-a6d54c55fa1a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:16.982760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cfc808f4-f7ac-4b44-826f-cc12ae85d956 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:16.997515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cfc808f4-f7ac-4b44-826f-cc12ae85d956 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1319 microversion: 2.1 time: 0.339237 May 17 22:13:17.005574 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 332/689] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:16 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:17.296101 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-57ba4837-dd40-484c-b64c-e6d3e5664b45 req-c49813f2-f8f7-473a-8670-6d54343da36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91ceec7-4d65-407e-b85f-da561fe693a2", "name": "network-vif-plugged", "status": "completed", "tag": "c018dbd8-fb54-4a5e-a5b1-3aa16ddebbc8"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:17.321851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-57ba4837-dd40-484c-b64c-e6d3e5664b45 req-c49813f2-f8f7-473a-8670-6d54343da36a service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:17.322336 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-57ba4837-dd40-484c-b64c-e6d3e5664b45 req-c49813f2-f8f7-473a-8670-6d54343da36a service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:17.355555 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-57ba4837-dd40-484c-b64c-e6d3e5664b45 req-c49813f2-f8f7-473a-8670-6d54343da36a service nova] Creating event network-vif-plugged:c018dbd8-fb54-4a5e-a5b1-3aa16ddebbc8 for instance b91ceec7-4d65-407e-b85f-da561fe693a2 on hv-cinder-83998 May 17 22:13:17.368133 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-57ba4837-dd40-484c-b64c-e6d3e5664b45 req-c49813f2-f8f7-473a-8670-6d54343da36a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073573 May 17 22:13:17.373728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 333/690] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:17.398076 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-709430ba-2658-4d10-940e-370e181869be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:17.398837 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-709430ba-2658-4d10-940e-370e181869be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:17.456382 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-709430ba-2658-4d10-940e-370e181869be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:17.458089 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-709430ba-2658-4d10-940e-370e181869be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:17.460126 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-709430ba-2658-4d10-940e-370e181869be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:17.460572 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-709430ba-2658-4d10-940e-370e181869be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:17.554197 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-709430ba-2658-4d10-940e-370e181869be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:17.554677 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-709430ba-2658-4d10-940e-370e181869be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:17.555149 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-709430ba-2658-4d10-940e-370e181869be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lazy-loading 'fault' on Instance uuid 429a5e1d-02ff-43b5-a293-584d721f62ca {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:13:17.557820 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9d93e4c9-0c3f-4cb1-b373-a6d54c55fa1a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:17.567081 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9d93e4c9-0c3f-4cb1-b373-a6d54c55fa1a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.643896 May 17 22:13:17.571921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 358/691] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:16 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:17.577070 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-68e4a8ad-648a-4cf6-80d2-da96129d895c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:17.588042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-68e4a8ad-648a-4cf6-80d2-da96129d895c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:17.611919 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68e4a8ad-648a-4cf6-80d2-da96129d895c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:17.612377 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68e4a8ad-648a-4cf6-80d2-da96129d895c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:17.613177 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68e4a8ad-648a-4cf6-80d2-da96129d895c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:17.616293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68e4a8ad-648a-4cf6-80d2-da96129d895c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:17.668797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-709430ba-2658-4d10-940e-370e181869be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:17.691299 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-709430ba-2658-4d10-940e-370e181869be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 200 len: 1331 microversion: 2.1 time: 0.297904 May 17 22:13:17.703211 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 334/692] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:17 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 1331 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:17.751477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-66ea8888-dade-42f9-aa7f-9ea218d750d9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:17.752585 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-66ea8888-dade-42f9-aa7f-9ea218d750d9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:17.774618 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-66ea8888-dade-42f9-aa7f-9ea218d750d9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:17.776276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-66ea8888-dade-42f9-aa7f-9ea218d750d9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:17.784757 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-66ea8888-dade-42f9-aa7f-9ea218d750d9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:17.785540 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-66ea8888-dade-42f9-aa7f-9ea218d750d9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:17.959911 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-68e4a8ad-648a-4cf6-80d2-da96129d895c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:17.977082 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-68e4a8ad-648a-4cf6-80d2-da96129d895c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1668 microversion: 2.1 time: 0.403710 May 17 22:13:18.005630 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 359/693] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:17 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1668 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:18.015489 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4f49392d-d9ba-4ccf-82cb-bd9546c52d34 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:18.016096 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4f49392d-d9ba-4ccf-82cb-bd9546c52d34 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:18.022838 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f49392d-d9ba-4ccf-82cb-bd9546c52d34 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:18.023969 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f49392d-d9ba-4ccf-82cb-bd9546c52d34 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:18.024773 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f49392d-d9ba-4ccf-82cb-bd9546c52d34 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:18.025207 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f49392d-d9ba-4ccf-82cb-bd9546c52d34 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:18.191401 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-66ea8888-dade-42f9-aa7f-9ea218d750d9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:18.201607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-66ea8888-dade-42f9-aa7f-9ea218d750d9 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.457133 May 17 22:13:18.204165 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 335/694] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:17 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:18.320977 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4f49392d-d9ba-4ccf-82cb-bd9546c52d34 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:18.330423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4f49392d-d9ba-4ccf-82cb-bd9546c52d34 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1319 microversion: 2.1 time: 0.318708 May 17 22:13:18.341320 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 360/695] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:18 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:18.588824 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c1686a41-15f6-4a7a-b30c-f1cb4272a0c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:18.589440 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c1686a41-15f6-4a7a-b30c-f1cb4272a0c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:18.598895 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1686a41-15f6-4a7a-b30c-f1cb4272a0c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:18.599380 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1686a41-15f6-4a7a-b30c-f1cb4272a0c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:18.600169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1686a41-15f6-4a7a-b30c-f1cb4272a0c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:18.600605 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c1686a41-15f6-4a7a-b30c-f1cb4272a0c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:18.714881 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-71b264c3-b04c-43ef-bf26-14abfb00c0bc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:18.716154 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-71b264c3-b04c-43ef-bf26-14abfb00c0bc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:18.729442 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71b264c3-b04c-43ef-bf26-14abfb00c0bc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:18.730810 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71b264c3-b04c-43ef-bf26-14abfb00c0bc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:18.731876 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71b264c3-b04c-43ef-bf26-14abfb00c0bc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:18.732871 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71b264c3-b04c-43ef-bf26-14abfb00c0bc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:18.761968 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-71b264c3-b04c-43ef-bf26-14abfb00c0bc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-71b264c3-b04c-43ef-bf26-14abfb00c0bc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca HTTP/1.1 May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:13:18.764964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:13:18.766892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:13:18.766892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:13:18.766892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:13:18.766892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:13:18.766892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:13:18.766892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:13:18.766892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:13:18.766892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:13:18.766892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:13:18.766892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:13:18.766892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:13:18.766892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '429a5e1d-02ff-43b5-a293-584d721f62ca'} May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:13:18.767657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:13:18.768921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:13:18.771890 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-71b264c3-b04c-43ef-bf26-14abfb00c0bc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 404 to user: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:13:18.772942 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-71b264c3-b04c-43ef-bf26-14abfb00c0bc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 404 len: 111 microversion: 2.1 time: 0.063155 May 17 22:13:18.773862 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 361/696] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:18 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 22:13:18.782933 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1a49f9f2-f7e6-424c-bb13-add150fc1b4d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '.version_select at 0x7f09f20e38b0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:18.791746 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c1686a41-15f6-4a7a-b30c-f1cb4272a0c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:18.801001 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c1686a41-15f6-4a7a-b30c-f1cb4272a0c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.215934 May 17 22:13:18.801913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 336/697] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:18 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:18.893872 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1a49f9f2-f7e6-424c-bb13-add150fc1b4d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015142436" status: 202 len: 0 microversion: 2.1 time: 0.114806 May 17 22:13:18.894860 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 362/698] 10.222.0.24 () {58 vars in 1220 bytes} [Tue May 17 22:13:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015142436 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:13:19.219182 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c9d44292-0315-48b3-ac5c-6cebec3f6384 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:19.223384 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c9d44292-0315-48b3-ac5c-6cebec3f6384 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:19.241032 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9d44292-0315-48b3-ac5c-6cebec3f6384 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:19.241556 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9d44292-0315-48b3-ac5c-6cebec3f6384 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:19.242560 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9d44292-0315-48b3-ac5c-6cebec3f6384 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:19.243413 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9d44292-0315-48b3-ac5c-6cebec3f6384 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:19.353471 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c4d1eef7-8852-440e-bdad-f714ba702d5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:19.354790 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c4d1eef7-8852-440e-bdad-f714ba702d5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:19.377505 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4d1eef7-8852-440e-bdad-f714ba702d5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:19.378842 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4d1eef7-8852-440e-bdad-f714ba702d5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:19.379814 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4d1eef7-8852-440e-bdad-f714ba702d5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:19.380491 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4d1eef7-8852-440e-bdad-f714ba702d5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:19.585829 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c9d44292-0315-48b3-ac5c-6cebec3f6384 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:19.603367 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c9d44292-0315-48b3-ac5c-6cebec3f6384 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.388251 May 17 22:13:19.603953 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 337/699] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:19 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:19.616042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c4d1eef7-8852-440e-bdad-f714ba702d5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:19.624512 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c4d1eef7-8852-440e-bdad-f714ba702d5e tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1319 microversion: 2.1 time: 0.279438 May 17 22:13:19.626428 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 363/700] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:19 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:19.820363 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bf2599a3-31ad-472c-85bb-386996dad27d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:19.821317 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bf2599a3-31ad-472c-85bb-386996dad27d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:19.828852 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf2599a3-31ad-472c-85bb-386996dad27d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:19.834372 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf2599a3-31ad-472c-85bb-386996dad27d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:19.834372 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf2599a3-31ad-472c-85bb-386996dad27d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:19.834372 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bf2599a3-31ad-472c-85bb-386996dad27d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:20.034962 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bf2599a3-31ad-472c-85bb-386996dad27d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:20.045688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bf2599a3-31ad-472c-85bb-386996dad27d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.230108 May 17 22:13:20.058663 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 338/701] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:19 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:20.236903 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-97409dd4-2d6b-4084-99fb-4f448ce541a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:20.236903 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-97409dd4-2d6b-4084-99fb-4f448ce541a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:20.243482 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97409dd4-2d6b-4084-99fb-4f448ce541a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:20.244215 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97409dd4-2d6b-4084-99fb-4f448ce541a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:20.245174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97409dd4-2d6b-4084-99fb-4f448ce541a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:20.245801 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97409dd4-2d6b-4084-99fb-4f448ce541a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:20.411447 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-97409dd4-2d6b-4084-99fb-4f448ce541a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lazy-loading 'services' on Instance uuid 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:13:20.627803 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7bcd66a9-cfc7-4880-89ab-ee813673f3a1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:20.630907 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7bcd66a9-cfc7-4880-89ab-ee813673f3a1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:20.635087 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7bcd66a9-cfc7-4880-89ab-ee813673f3a1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:20.636063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7bcd66a9-cfc7-4880-89ab-ee813673f3a1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:20.643839 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7bcd66a9-cfc7-4880-89ab-ee813673f3a1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:20.644315 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7bcd66a9-cfc7-4880-89ab-ee813673f3a1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:20.717178 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-97409dd4-2d6b-4084-99fb-4f448ce541a3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831/os-volume_attachments/99dfd24f-271d-4bfb-a06b-1cc0830b14b1" status: 202 len: 0 microversion: 2.1 time: 0.484265 May 17 22:13:20.721675 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 364/702] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 17 22:13:20 2022] DELETE /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831/os-volume_attachments/99dfd24f-271d-4bfb-a06b-1cc0830b14b1 => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:13:20.730397 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-31a0946f-392f-4028-808d-f27fb291300b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:20.731640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-31a0946f-392f-4028-808d-f27fb291300b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:20.739838 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-31a0946f-392f-4028-808d-f27fb291300b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:20.740656 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-31a0946f-392f-4028-808d-f27fb291300b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:20.741799 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-31a0946f-392f-4028-808d-f27fb291300b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:20.742520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-31a0946f-392f-4028-808d-f27fb291300b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:20.886186 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7bcd66a9-cfc7-4880-89ab-ee813673f3a1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:20.902741 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7bcd66a9-cfc7-4880-89ab-ee813673f3a1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.279670 May 17 22:13:20.904770 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 339/703] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:20 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:20.916697 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c9d641c2-3e0c-4920-b223-3d86b739fcdd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:20.917967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c9d641c2-3e0c-4920-b223-3d86b739fcdd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:20.926799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9d641c2-3e0c-4920-b223-3d86b739fcdd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:20.927346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9d641c2-3e0c-4920-b223-3d86b739fcdd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:20.928538 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9d641c2-3e0c-4920-b223-3d86b739fcdd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:20.929518 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c9d641c2-3e0c-4920-b223-3d86b739fcdd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:20.991051 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-31a0946f-392f-4028-808d-f27fb291300b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:20.998891 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c9d641c2-3e0c-4920-b223-3d86b739fcdd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091678 May 17 22:13:21.000020 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-31a0946f-392f-4028-808d-f27fb291300b tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1508 microversion: 2.1 time: 0.276402 May 17 22:13:21.001252 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 365/704] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:20 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1508 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:21.001693 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 340/705] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:13:20 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:21.016720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-74460b04-00b0-4f63-abae-26711602fdb7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3206f9be-9852-4386-a697-dbab5f602672", "device": "/dev/sdb"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:21.018884 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-74460b04-00b0-4f63-abae-26711602fdb7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:21.025477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-74460b04-00b0-4f63-abae-26711602fdb7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:21.025928 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-74460b04-00b0-4f63-abae-26711602fdb7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:21.026712 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-74460b04-00b0-4f63-abae-26711602fdb7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:21.027232 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-74460b04-00b0-4f63-abae-26711602fdb7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:21.066827 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-49bf3539-f9ff-45e5-b974-86c196c732b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:21.068219 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-49bf3539-f9ff-45e5-b974-86c196c732b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:21.074315 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49bf3539-f9ff-45e5-b974-86c196c732b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:21.075008 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49bf3539-f9ff-45e5-b974-86c196c732b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:21.075861 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49bf3539-f9ff-45e5-b974-86c196c732b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:21.076255 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49bf3539-f9ff-45e5-b974-86c196c732b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:21.265262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-49bf3539-f9ff-45e5-b974-86c196c732b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:21.274594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-49bf3539-f9ff-45e5-b974-86c196c732b2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.212583 May 17 22:13:21.275225 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 341/706] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:21 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:21.923035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b5e0b87e-ced5-4299-a764-79305a2d10e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:21.923934 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b5e0b87e-ced5-4299-a764-79305a2d10e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:21.933973 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5e0b87e-ced5-4299-a764-79305a2d10e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:21.941241 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5e0b87e-ced5-4299-a764-79305a2d10e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:21.942589 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5e0b87e-ced5-4299-a764-79305a2d10e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:21.943139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b5e0b87e-ced5-4299-a764-79305a2d10e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:22.033708 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-74460b04-00b0-4f63-abae-26711602fdb7 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "POST /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.020615 May 17 22:13:22.034517 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 366/707] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:13:21 2022] POST /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2/os-volume_attachments => generated 194 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:13:22.044827 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-58324f38-9a3b-431d-b3a9-5b89da5d8f68 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:22.045921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-58324f38-9a3b-431d-b3a9-5b89da5d8f68 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:22.068962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58324f38-9a3b-431d-b3a9-5b89da5d8f68 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:22.069542 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58324f38-9a3b-431d-b3a9-5b89da5d8f68 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:22.070621 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58324f38-9a3b-431d-b3a9-5b89da5d8f68 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:22.071268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58324f38-9a3b-431d-b3a9-5b89da5d8f68 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:22.120257 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b5e0b87e-ced5-4299-a764-79305a2d10e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:22.131849 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b5e0b87e-ced5-4299-a764-79305a2d10e8 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.213346 May 17 22:13:22.132450 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 342/708] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:21 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:22.153879 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-58324f38-9a3b-431d-b3a9-5b89da5d8f68 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110239 May 17 22:13:22.154818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 367/709] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:13:22 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 22:13:22.228206 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b89a2e64-b3e5-44c2-b8de-787af43c6c52 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:22.237797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b89a2e64-b3e5-44c2-b8de-787af43c6c52 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:22.237797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b89a2e64-b3e5-44c2-b8de-787af43c6c52 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:22.237797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b89a2e64-b3e5-44c2-b8de-787af43c6c52 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:22.237797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b89a2e64-b3e5-44c2-b8de-787af43c6c52 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:22.238460 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b89a2e64-b3e5-44c2-b8de-787af43c6c52 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:22.270785 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b89a2e64-b3e5-44c2-b8de-787af43c6c52 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:13:22.293684 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fb3cb32a-f852-43bf-b20b-e910fa4c3527 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:22.294334 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fb3cb32a-f852-43bf-b20b-e910fa4c3527 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:22.301261 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fb3cb32a-f852-43bf-b20b-e910fa4c3527 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:22.303757 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fb3cb32a-f852-43bf-b20b-e910fa4c3527 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:22.304759 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fb3cb32a-f852-43bf-b20b-e910fa4c3527 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:22.305381 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fb3cb32a-f852-43bf-b20b-e910fa4c3527 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:22.483942 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fb3cb32a-f852-43bf-b20b-e910fa4c3527 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:22.495318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fb3cb32a-f852-43bf-b20b-e910fa4c3527 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.205116 May 17 22:13:22.503621 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 368/710] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:22 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:22.623648 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b89a2e64-b3e5-44c2-b8de-787af43c6c52 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 204 len: 0 microversion: 2.1 time: 0.401210 May 17 22:13:22.629930 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 343/711] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:13:22 2022] DELETE /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:13:22.634004 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bd9cdd0a-8074-4d21-9858-4b44ed1111b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:22.640024 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bd9cdd0a-8074-4d21-9858-4b44ed1111b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:22.641164 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd9cdd0a-8074-4d21-9858-4b44ed1111b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:22.641901 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd9cdd0a-8074-4d21-9858-4b44ed1111b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:22.643120 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd9cdd0a-8074-4d21-9858-4b44ed1111b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:22.643700 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bd9cdd0a-8074-4d21-9858-4b44ed1111b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:22.801306 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-bd9cdd0a-8074-4d21-9858-4b44ed1111b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:22.810077 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bd9cdd0a-8074-4d21-9858-4b44ed1111b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1679 microversion: 2.1 time: 0.180278 May 17 22:13:22.810914 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 369/712] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:22 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:23.150506 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a3c81598-c4eb-4584-bc1c-c2d201ba5dc1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:23.151246 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a3c81598-c4eb-4584-bc1c-c2d201ba5dc1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:23.169061 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3c81598-c4eb-4584-bc1c-c2d201ba5dc1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:23.175279 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3c81598-c4eb-4584-bc1c-c2d201ba5dc1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:23.176337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3c81598-c4eb-4584-bc1c-c2d201ba5dc1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:23.176877 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3c81598-c4eb-4584-bc1c-c2d201ba5dc1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:23.332471 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a3c81598-c4eb-4584-bc1c-c2d201ba5dc1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:23.340278 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a3c81598-c4eb-4584-bc1c-c2d201ba5dc1 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.194208 May 17 22:13:23.340851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 344/713] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:23 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:23.513674 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8e19a6b7-ccd3-4bac-a970-1e1285b858c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:23.514366 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8e19a6b7-ccd3-4bac-a970-1e1285b858c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:23.521160 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8e19a6b7-ccd3-4bac-a970-1e1285b858c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:23.521746 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8e19a6b7-ccd3-4bac-a970-1e1285b858c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:23.522647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8e19a6b7-ccd3-4bac-a970-1e1285b858c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:23.523152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8e19a6b7-ccd3-4bac-a970-1e1285b858c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:23.666218 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8e19a6b7-ccd3-4bac-a970-1e1285b858c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:23.675959 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8e19a6b7-ccd3-4bac-a970-1e1285b858c4 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.166103 May 17 22:13:23.677069 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 370/714] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:23 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:23.827696 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8fcced75-ae5d-43d6-a3d4-64df866fabed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:23.828339 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8fcced75-ae5d-43d6-a3d4-64df866fabed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:23.837281 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8fcced75-ae5d-43d6-a3d4-64df866fabed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:23.837983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8fcced75-ae5d-43d6-a3d4-64df866fabed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:23.838915 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8fcced75-ae5d-43d6-a3d4-64df866fabed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:23.839520 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8fcced75-ae5d-43d6-a3d4-64df866fabed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:24.001903 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8fcced75-ae5d-43d6-a3d4-64df866fabed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:24.012752 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8fcced75-ae5d-43d6-a3d4-64df866fabed tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1679 microversion: 2.1 time: 0.188695 May 17 22:13:24.013897 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 345/715] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:23 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:24.359276 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-99d88745-786c-4bee-bfd6-4cb3378c5596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:24.360540 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-99d88745-786c-4bee-bfd6-4cb3378c5596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:24.369046 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-99d88745-786c-4bee-bfd6-4cb3378c5596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:24.369492 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-99d88745-786c-4bee-bfd6-4cb3378c5596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:24.370257 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-99d88745-786c-4bee-bfd6-4cb3378c5596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:24.370683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-99d88745-786c-4bee-bfd6-4cb3378c5596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:24.526046 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-99d88745-786c-4bee-bfd6-4cb3378c5596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:24.534549 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-99d88745-786c-4bee-bfd6-4cb3378c5596 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.179209 May 17 22:13:24.535393 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 371/716] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:24 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:24.696973 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-17eb00be-0023-49a9-a355-15f614bfcbce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:24.698178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-17eb00be-0023-49a9-a355-15f614bfcbce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:24.707822 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-17eb00be-0023-49a9-a355-15f614bfcbce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:24.708554 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-17eb00be-0023-49a9-a355-15f614bfcbce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:24.709493 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-17eb00be-0023-49a9-a355-15f614bfcbce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:24.710598 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-17eb00be-0023-49a9-a355-15f614bfcbce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:25.018930 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-17eb00be-0023-49a9-a355-15f614bfcbce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:25.036836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6bf25c97-9b60-42a5-a7ba-4fd7c92a4fc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:25.039945 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6bf25c97-9b60-42a5-a7ba-4fd7c92a4fc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:25.046579 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-17eb00be-0023-49a9-a355-15f614bfcbce tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.354963 May 17 22:13:25.051996 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 346/717] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:24 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:25.059347 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6bf25c97-9b60-42a5-a7ba-4fd7c92a4fc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:25.060076 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6bf25c97-9b60-42a5-a7ba-4fd7c92a4fc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:25.061768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6bf25c97-9b60-42a5-a7ba-4fd7c92a4fc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:25.065036 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6bf25c97-9b60-42a5-a7ba-4fd7c92a4fc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:25.333173 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6bf25c97-9b60-42a5-a7ba-4fd7c92a4fc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:25.358482 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6bf25c97-9b60-42a5-a7ba-4fd7c92a4fc1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1679 microversion: 2.1 time: 0.328137 May 17 22:13:25.368417 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 372/718] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:25 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1679 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:25.565923 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4fdc667f-33d6-4721-9005-dab9814ea707 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:25.567485 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4fdc667f-33d6-4721-9005-dab9814ea707 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:25.595912 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4fdc667f-33d6-4721-9005-dab9814ea707 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:25.599346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4fdc667f-33d6-4721-9005-dab9814ea707 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:25.600351 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4fdc667f-33d6-4721-9005-dab9814ea707 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:25.600803 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4fdc667f-33d6-4721-9005-dab9814ea707 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:25.829288 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4fdc667f-33d6-4721-9005-dab9814ea707 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:25.841382 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4fdc667f-33d6-4721-9005-dab9814ea707 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.291685 May 17 22:13:25.854631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 347/719] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:25 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:26.046498 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-0329c88e-b4fa-4084-b62f-f0d3b170e174 req-2cd141e9-5539-4bd8-9172-8f098ccf6103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120f12ef-0f38-41f4-a47d-2fdb6ffe8831", "name": "network-vif-deleted", "tag": "6bf3020e-df21-491a-8ec0-6c8d0f806985"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:26.055631 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-0329c88e-b4fa-4084-b62f-f0d3b170e174 req-2cd141e9-5539-4bd8-9172-8f098ccf6103 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:26.062063 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-0329c88e-b4fa-4084-b62f-f0d3b170e174 req-2cd141e9-5539-4bd8-9172-8f098ccf6103 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:26.071012 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eb6576bb-38a6-4c89-b9e2-04a9331ec116 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:26.071805 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eb6576bb-38a6-4c89-b9e2-04a9331ec116 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:26.086362 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb6576bb-38a6-4c89-b9e2-04a9331ec116 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:26.089186 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb6576bb-38a6-4c89-b9e2-04a9331ec116 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:26.089408 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-0329c88e-b4fa-4084-b62f-f0d3b170e174 req-2cd141e9-5539-4bd8-9172-8f098ccf6103 service nova] Creating event network-vif-deleted:6bf3020e-df21-491a-8ec0-6c8d0f806985 for instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 on hv-cinder-83998 May 17 22:13:26.090188 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb6576bb-38a6-4c89-b9e2-04a9331ec116 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:26.090755 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eb6576bb-38a6-4c89-b9e2-04a9331ec116 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:26.096572 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-0329c88e-b4fa-4084-b62f-f0d3b170e174 req-2cd141e9-5539-4bd8-9172-8f098ccf6103 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053802 May 17 22:13:26.100575 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 373/720] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:26.322530 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eb6576bb-38a6-4c89-b9e2-04a9331ec116 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:26.332380 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eb6576bb-38a6-4c89-b9e2-04a9331ec116 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.267080 May 17 22:13:26.333174 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 348/721] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:26 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:26.378429 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-89be7fc4-88c3-4d13-a170-0d777c1235f6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:26.380816 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-89be7fc4-88c3-4d13-a170-0d777c1235f6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:26.389485 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-89be7fc4-88c3-4d13-a170-0d777c1235f6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:26.390461 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-89be7fc4-88c3-4d13-a170-0d777c1235f6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:26.392758 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-89be7fc4-88c3-4d13-a170-0d777c1235f6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:26.393603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-89be7fc4-88c3-4d13-a170-0d777c1235f6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:26.435899 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-89be7fc4-88c3-4d13-a170-0d777c1235f6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:26.436668 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-89be7fc4-88c3-4d13-a170-0d777c1235f6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:26.437606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-89be7fc4-88c3-4d13-a170-0d777c1235f6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lazy-loading 'fault' on Instance uuid 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:13:26.509804 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-89be7fc4-88c3-4d13-a170-0d777c1235f6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:26.517188 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-89be7fc4-88c3-4d13-a170-0d777c1235f6 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 200 len: 1330 microversion: 2.1 time: 0.143726 May 17 22:13:26.517752 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 374/722] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:26 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 1330 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:26.861349 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a95fa3d2-b232-4266-b471-33bb7292286c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:26.862796 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a95fa3d2-b232-4266-b471-33bb7292286c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:26.882708 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a95fa3d2-b232-4266-b471-33bb7292286c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:26.883582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a95fa3d2-b232-4266-b471-33bb7292286c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:26.884660 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a95fa3d2-b232-4266-b471-33bb7292286c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:26.885286 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a95fa3d2-b232-4266-b471-33bb7292286c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:27.080422 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a95fa3d2-b232-4266-b471-33bb7292286c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:27.088355 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a95fa3d2-b232-4266-b471-33bb7292286c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.231009 May 17 22:13:27.099229 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 349/723] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:26 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:27.352992 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-23a80217-b038-4a2b-8f48-02044274c040 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:27.353714 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-23a80217-b038-4a2b-8f48-02044274c040 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:27.363613 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-23a80217-b038-4a2b-8f48-02044274c040 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:27.364292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-23a80217-b038-4a2b-8f48-02044274c040 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:27.365711 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-23a80217-b038-4a2b-8f48-02044274c040 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:27.366302 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-23a80217-b038-4a2b-8f48-02044274c040 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:27.533996 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5769b8c4-c932-44fc-b9cc-651bd4a6852e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:27.538747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5769b8c4-c932-44fc-b9cc-651bd4a6852e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:27.544946 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5769b8c4-c932-44fc-b9cc-651bd4a6852e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:27.545397 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5769b8c4-c932-44fc-b9cc-651bd4a6852e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:27.546205 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5769b8c4-c932-44fc-b9cc-651bd4a6852e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:27.546631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5769b8c4-c932-44fc-b9cc-651bd4a6852e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:27.562439 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-5769b8c4-c932-44fc-b9cc-651bd4a6852e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5769b8c4-c932-44fc-b9cc-651bd4a6852e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 HTTP/1.1 May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:13:27.566662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:13:27.568227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:13:27.568227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:13:27.568227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:13:27.568227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:13:27.568227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:13:27.568227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:13:27.568227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:13:27.568227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:13:27.568227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:13:27.568227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:13:27.568227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:13:27.568227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '120f12ef-0f38-41f4-a47d-2fdb6ffe8831'} May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:13:27.569357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:13:27.570760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:27.572811 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5769b8c4-c932-44fc-b9cc-651bd4a6852e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 404 to user: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:13:27.573821 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5769b8c4-c932-44fc-b9cc-651bd4a6852e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 404 len: 111 microversion: 2.1 time: 0.043733 May 17 22:13:27.577920 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 350/724] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:27 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:13:27.582943 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0672695f-a5ea-4e29-92f2-10ff161a1ec8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '.version_select at 0x7f09f2175dc0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:27.586394 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0672695f-a5ea-4e29-92f2-10ff161a1ec8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [244932cc-3c33-400e-a639-987e0152df3c] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 22:13:27.590668 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-23a80217-b038-4a2b-8f48-02044274c040 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:27.601932 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-23a80217-b038-4a2b-8f48-02044274c040 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.253128 May 17 22:13:27.602712 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 375/725] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:27 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:28.107723 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3e5c95f5-7796-4941-9799-5be7d5160442 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:28.109071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3e5c95f5-7796-4941-9799-5be7d5160442 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:28.118377 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e5c95f5-7796-4941-9799-5be7d5160442 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:28.119049 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e5c95f5-7796-4941-9799-5be7d5160442 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:28.120195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e5c95f5-7796-4941-9799-5be7d5160442 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:28.120988 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3e5c95f5-7796-4941-9799-5be7d5160442 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:28.284148 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3e5c95f5-7796-4941-9799-5be7d5160442 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:28.294563 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3e5c95f5-7796-4941-9799-5be7d5160442 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.191907 May 17 22:13:28.295496 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 376/726] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:28 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:28.596258 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [None req-0672695f-a5ea-4e29-92f2-10ff161a1ec8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [244932cc-3c33-400e-a639-987e0152df3c] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 45178. May 17 22:13:28.620327 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-23d5c582-d78d-41e5-b010-9de3216dcdd2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:28.636598 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-23d5c582-d78d-41e5-b010-9de3216dcdd2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:28.636598 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-23d5c582-d78d-41e5-b010-9de3216dcdd2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:28.636598 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-23d5c582-d78d-41e5-b010-9de3216dcdd2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:28.636598 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-23d5c582-d78d-41e5-b010-9de3216dcdd2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:28.637029 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-23d5c582-d78d-41e5-b010-9de3216dcdd2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:28.726275 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0672695f-a5ea-4e29-92f2-10ff161a1ec8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140229721" status: 202 len: 0 microversion: 2.1 time: 1.144755 May 17 22:13:28.727136 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 351/727] 10.222.0.24 () {58 vars in 1220 bytes} [Tue May 17 22:13:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140229721 => generated 0 bytes in 1148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:13:28.852592 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-23d5c582-d78d-41e5-b010-9de3216dcdd2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:28.863082 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-23d5c582-d78d-41e5-b010-9de3216dcdd2 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.246805 May 17 22:13:28.873822 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 377/728] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:28 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:29.315041 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f86039c0-3fa7-4360-8931-5a55c4551a39 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:29.316299 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f86039c0-3fa7-4360-8931-5a55c4551a39 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:29.327394 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f86039c0-3fa7-4360-8931-5a55c4551a39 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:29.328085 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f86039c0-3fa7-4360-8931-5a55c4551a39 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:29.329601 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f86039c0-3fa7-4360-8931-5a55c4551a39 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:29.330150 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f86039c0-3fa7-4360-8931-5a55c4551a39 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:29.480625 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f86039c0-3fa7-4360-8931-5a55c4551a39 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:29.489488 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f86039c0-3fa7-4360-8931-5a55c4551a39 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.179655 May 17 22:13:29.490049 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 352/729] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:29 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:29.728833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e1c3006d-c5f9-4e02-a62b-99ce6222425c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: .version_select at 0x7f09f72d8670>, body: {"keypair": {"name": "tempest-keypair-218001136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSwyUrKwzYX+YtNtSvkWvzhYtmyEwW9TLdWuF/zadfIEgC5haCjH1yN1YwCavJd18nak9dQKq2Eia9M4aQZ/n4TNJcFGQhTaI7csVdunQMQUNOlhzNaArti2SaOoNWXBQ=="}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:29.743777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-e1c3006d-c5f9-4e02-a62b-99ce6222425c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for project ea0809b61be446a69359b69b50b61710. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:13:29.747931 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-e1c3006d-c5f9-4e02-a62b-99ce6222425c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for user 4bbb6a0a08464e738ef0d062dfe87182 and project ea0809b61be446a69359b69b50b61710. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:13:29.830106 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e1c3006d-c5f9-4e02-a62b-99ce6222425c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105166 May 17 22:13:29.831349 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 378/730] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 17 22:13:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:29.882539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4bdd1a7d-3f10-4847-9996-078698da0b6c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:29.883157 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4bdd1a7d-3f10-4847-9996-078698da0b6c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:29.889806 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4bdd1a7d-3f10-4847-9996-078698da0b6c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:29.890429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4bdd1a7d-3f10-4847-9996-078698da0b6c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:29.891598 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4bdd1a7d-3f10-4847-9996-078698da0b6c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:29.892339 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4bdd1a7d-3f10-4847-9996-078698da0b6c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:30.069159 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4bdd1a7d-3f10-4847-9996-078698da0b6c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:30.079872 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4bdd1a7d-3f10-4847-9996-078698da0b6c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.201483 May 17 22:13:30.090430 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 353/731] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:29 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:30.506530 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ab56bfed-bf95-46e3-89ee-e935b2da7822 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:30.509757 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ab56bfed-bf95-46e3-89ee-e935b2da7822 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:30.516937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ab56bfed-bf95-46e3-89ee-e935b2da7822 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:30.516937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ab56bfed-bf95-46e3-89ee-e935b2da7822 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:30.517559 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ab56bfed-bf95-46e3-89ee-e935b2da7822 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:30.517998 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ab56bfed-bf95-46e3-89ee-e935b2da7822 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:30.659995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ab56bfed-bf95-46e3-89ee-e935b2da7822 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:30.661091 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ab56bfed-bf95-46e3-89ee-e935b2da7822 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1737 microversion: 2.1 time: 0.159008 May 17 22:13:30.661999 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 379/732] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:30 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:31.097637 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7620e5a2-1693-4f26-bd7d-8999c5d34cd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:31.098232 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7620e5a2-1693-4f26-bd7d-8999c5d34cd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:31.104715 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7620e5a2-1693-4f26-bd7d-8999c5d34cd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:31.105169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7620e5a2-1693-4f26-bd7d-8999c5d34cd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:31.105943 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7620e5a2-1693-4f26-bd7d-8999c5d34cd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:31.106378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7620e5a2-1693-4f26-bd7d-8999c5d34cd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:31.250983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7620e5a2-1693-4f26-bd7d-8999c5d34cd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:31.258908 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7620e5a2-1693-4f26-bd7d-8999c5d34cd7 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.165744 May 17 22:13:31.259511 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 354/733] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:31 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:31.678149 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0ee8e647-b483-4958-b213-0afbd9b76bf7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:31.678745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0ee8e647-b483-4958-b213-0afbd9b76bf7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:31.685230 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ee8e647-b483-4958-b213-0afbd9b76bf7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:31.685871 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ee8e647-b483-4958-b213-0afbd9b76bf7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:31.686645 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ee8e647-b483-4958-b213-0afbd9b76bf7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:31.687079 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0ee8e647-b483-4958-b213-0afbd9b76bf7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:31.836744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0ee8e647-b483-4958-b213-0afbd9b76bf7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:31.845779 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0ee8e647-b483-4958-b213-0afbd9b76bf7 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1717 microversion: 2.1 time: 0.171452 May 17 22:13:31.847218 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 380/734] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:31 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:31.978024 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3d427216-b867-44a8-8188-93be4db31e04 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:31.978744 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3d427216-b867-44a8-8188-93be4db31e04 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:31.985626 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d427216-b867-44a8-8188-93be4db31e04 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:31.986293 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d427216-b867-44a8-8188-93be4db31e04 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:31.987074 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d427216-b867-44a8-8188-93be4db31e04 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:31.987581 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3d427216-b867-44a8-8188-93be4db31e04 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:32.079335 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-3d427216-b867-44a8-8188-93be4db31e04 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] HTTP exception thrown: Cannot 'detach_volume' instance da3e521e-c843-4727-8c31-00c86e4e6aa0 while it is in vm_state rescued May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3d427216-b867-44a8-8188-93be4db31e04 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Request method failure captured: May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: DELETE /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments/b1a5b4fb-9987-43f9-a237-264fec6faf4f HTTP/1.1 May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0P0UB5_uQfKTuVZPhH7DNkYAdH4uRgkhSs_b6rbwPZ_1fapkgG_r3KdEbs4XGm2C_Rp1CTTOgvsoNQrwuCSt2PBbkFf06sbYA1Ukg8-odEmBZ2p0sSFzwtGdwavI4iQdBU7car_6jAD2weQQcjBgdczxsrbNA_K4dLU0356ZlF5Ao May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 7a0d6701b5d5441eb7eaf815d273d4d9 May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:13:32.080860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:13:32.085774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7a0d6701b5d5441eb7eaf815d273d4d9", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:13:32.085774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:13:32.085774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 7a0d6701b5d5441eb7eaf815d273d4d9 May 17 22:13:32.085774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:13:32.085774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-ServerRescueNegativeTestJSON-127931416-project May 17 22:13:32.085774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:13:32.085774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:13:32.085774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 8cc69cd4250c436e8b893887604b2273 May 17 22:13:32.085774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-127931416-project May 17 22:13:32.085774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:13:32.085774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Cannot 'detach_volume' instance da3e521e-c843-4727-8c31-00c86e4e6aa0 while it is in vm_state rescued May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'server_id': 'da3e521e-c843-4727-8c31-00c86e4e6aa0', 'id': 'b1a5b4fb-9987-43f9-a237-264fec6faf4f'} May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance da3e521e-c843-4727-8c31-00c86e4e6aa0 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:13:32.086582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance da3e521e-c843-4727-8c31-00c86e4e6aa0 while it is in vm_state rescued May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance da3e521e-c843-4727-8c31-00c86e4e6aa0 while it is in vm_state rescued May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:32.088240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3d427216-b867-44a8-8188-93be4db31e04 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Returning 409 to user: Cannot 'detach_volume' instance da3e521e-c843-4727-8c31-00c86e4e6aa0 while it is in vm_state rescued {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:13:32.089389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3d427216-b867-44a8-8188-93be4db31e04 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "DELETE /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments/b1a5b4fb-9987-43f9-a237-264fec6faf4f" status: 409 len: 152 microversion: 2.1 time: 0.109685 May 17 22:13:32.089389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 355/735] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 17 22:13:31 2022] DELETE /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments/b1a5b4fb-9987-43f9-a237-264fec6faf4f => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 17 22:13:32.090859 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-58d375cb-36db-49a8-bcb6-52c9d83e3e53 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:32.091429 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-58d375cb-36db-49a8-bcb6-52c9d83e3e53 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:32.097531 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58d375cb-36db-49a8-bcb6-52c9d83e3e53 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:32.097977 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58d375cb-36db-49a8-bcb6-52c9d83e3e53 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:32.098763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58d375cb-36db-49a8-bcb6-52c9d83e3e53 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:32.099198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-58d375cb-36db-49a8-bcb6-52c9d83e3e53 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:32.220187 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1095616762", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f877e2b-99bd-48e8-8b73-18e37441b914"}], "security_groups": [{"name": "tempest-securitygroup--1708425232"}], "key_name": "tempest-keypair-218001136", "user_data": "}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:32.324209 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] validate_networks() for [('6f877e2b-99bd-48e8-8b73-18e37441b914', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:13:32.395074 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-58d375cb-36db-49a8-bcb6-52c9d83e3e53 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "POST /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/action" status: 202 len: 0 microversion: 2.1 time: 0.307734 May 17 22:13:32.396035 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 381/736] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:13:32 2022] POST /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:13:32.401035 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cd2cee3c-f7cb-41c8-94e9-ac2d19f67fdc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:32.401971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cd2cee3c-f7cb-41c8-94e9-ac2d19f67fdc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:32.411872 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd2cee3c-f7cb-41c8-94e9-ac2d19f67fdc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:32.412418 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd2cee3c-f7cb-41c8-94e9-ac2d19f67fdc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:32.413094 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd2cee3c-f7cb-41c8-94e9-ac2d19f67fdc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:32.413690 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cd2cee3c-f7cb-41c8-94e9-ac2d19f67fdc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:32.764294 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cd2cee3c-f7cb-41c8-94e9-ac2d19f67fdc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:32.773645 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-cd2cee3c-f7cb-41c8-94e9-ac2d19f67fdc tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.376477 May 17 22:13:32.774626 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 382/737] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:32 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:32.793133 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2cbccb06-a9b1-442b-b1a1-898ffd1804f6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:32.793756 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2cbccb06-a9b1-442b-b1a1-898ffd1804f6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:32.803343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cbccb06-a9b1-442b-b1a1-898ffd1804f6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:32.803343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cbccb06-a9b1-442b-b1a1-898ffd1804f6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:32.803343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cbccb06-a9b1-442b-b1a1-898ffd1804f6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:32.803343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2cbccb06-a9b1-442b-b1a1-898ffd1804f6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:33.052172 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:13:33.052702 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:13:33.053288 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:13:33.053764 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:13:33.054388 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:13:33.064315 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:33.064671 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:33.065502 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:33.065941 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:33.074359 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2cbccb06-a9b1-442b-b1a1-898ffd1804f6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:33.082834 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2cbccb06-a9b1-442b-b1a1-898ffd1804f6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1725 microversion: 2.1 time: 0.306369 May 17 22:13:33.083834 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 383/738] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:32 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1725 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:33.085486 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for project ea0809b61be446a69359b69b50b61710. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:13:33.089569 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for user 4bbb6a0a08464e738ef0d062dfe87182 and project ea0809b61be446a69359b69b50b61710. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:13:33.101821 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:13:33.105342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:13:33.247419 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-943d005f-0a59-4d03-a7dd-b4b5e3b454c8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.031361 May 17 22:13:33.254094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 356/739] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:13:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 22:13:33.260121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-76b0c260-7fa3-4fba-ac44-5407e00b7e5b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:33.260719 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-76b0c260-7fa3-4fba-ac44-5407e00b7e5b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:33.354245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-76b0c260-7fa3-4fba-ac44-5407e00b7e5b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:33.365171 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-76b0c260-7fa3-4fba-ac44-5407e00b7e5b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1241 microversion: 2.1 time: 0.109107 May 17 22:13:33.366017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 384/740] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:33 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:33.793197 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c77b2dd5-1502-4acd-bc87-0c7c5f9b2169 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:33.793802 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c77b2dd5-1502-4acd-bc87-0c7c5f9b2169 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:33.800811 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c77b2dd5-1502-4acd-bc87-0c7c5f9b2169 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:33.801262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c77b2dd5-1502-4acd-bc87-0c7c5f9b2169 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:33.802026 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c77b2dd5-1502-4acd-bc87-0c7c5f9b2169 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:33.802457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c77b2dd5-1502-4acd-bc87-0c7c5f9b2169 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:33.946345 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c77b2dd5-1502-4acd-bc87-0c7c5f9b2169 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:33.955026 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c77b2dd5-1502-4acd-bc87-0c7c5f9b2169 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.165950 May 17 22:13:33.955636 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 357/741] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:33 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:34.100294 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e32d299d-b4d6-43f4-a337-802a39491d69 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:34.100997 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e32d299d-b4d6-43f4-a337-802a39491d69 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:34.108125 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e32d299d-b4d6-43f4-a337-802a39491d69 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:34.108574 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e32d299d-b4d6-43f4-a337-802a39491d69 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:34.109345 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e32d299d-b4d6-43f4-a337-802a39491d69 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:34.110020 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e32d299d-b4d6-43f4-a337-802a39491d69 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:34.382402 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9247f7c1-0083-4afe-aacf-33434597c83e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:34.383019 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9247f7c1-0083-4afe-aacf-33434597c83e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:34.389092 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9247f7c1-0083-4afe-aacf-33434597c83e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:34.389540 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9247f7c1-0083-4afe-aacf-33434597c83e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:34.390340 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9247f7c1-0083-4afe-aacf-33434597c83e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:34.391306 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9247f7c1-0083-4afe-aacf-33434597c83e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:34.489278 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e32d299d-b4d6-43f4-a337-802a39491d69 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:34.497096 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e32d299d-b4d6-43f4-a337-802a39491d69 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1725 microversion: 2.1 time: 0.400660 May 17 22:13:34.497659 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 385/742] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:34 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1725 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:34.505641 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9247f7c1-0083-4afe-aacf-33434597c83e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:34.513153 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9247f7c1-0083-4afe-aacf-33434597c83e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1245 microversion: 2.1 time: 0.134523 May 17 22:13:34.513711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 358/743] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:34 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1245 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:34.973391 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a5af8696-ad7a-4f0a-a63a-d5718d776fa3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:34.973991 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a5af8696-ad7a-4f0a-a63a-d5718d776fa3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:34.980036 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5af8696-ad7a-4f0a-a63a-d5718d776fa3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:34.980479 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5af8696-ad7a-4f0a-a63a-d5718d776fa3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:34.981230 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5af8696-ad7a-4f0a-a63a-d5718d776fa3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:34.981656 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5af8696-ad7a-4f0a-a63a-d5718d776fa3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:35.119802 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a5af8696-ad7a-4f0a-a63a-d5718d776fa3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:35.127715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a5af8696-ad7a-4f0a-a63a-d5718d776fa3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.159034 May 17 22:13:35.128274 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 386/744] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:34 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:35.514606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-42e9d6a1-6c61-4ce2-aaa6-76a2c8633a3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:35.515258 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-42e9d6a1-6c61-4ce2-aaa6-76a2c8633a3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:35.522477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42e9d6a1-6c61-4ce2-aaa6-76a2c8633a3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:35.522919 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42e9d6a1-6c61-4ce2-aaa6-76a2c8633a3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:35.523753 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42e9d6a1-6c61-4ce2-aaa6-76a2c8633a3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:35.524134 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-42e9d6a1-6c61-4ce2-aaa6-76a2c8633a3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:35.529626 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8f6c45fc-f0e2-4552-a34f-a09a185790cd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:35.530240 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8f6c45fc-f0e2-4552-a34f-a09a185790cd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:35.536041 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f6c45fc-f0e2-4552-a34f-a09a185790cd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:35.536495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f6c45fc-f0e2-4552-a34f-a09a185790cd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:35.537267 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f6c45fc-f0e2-4552-a34f-a09a185790cd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:35.537707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8f6c45fc-f0e2-4552-a34f-a09a185790cd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:35.618608 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8f6c45fc-f0e2-4552-a34f-a09a185790cd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:35.626414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8f6c45fc-f0e2-4552-a34f-a09a185790cd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1245 microversion: 2.1 time: 0.100655 May 17 22:13:35.626983 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 387/745] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:35 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1245 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:35.673865 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-42e9d6a1-6c61-4ce2-aaa6-76a2c8633a3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:35.681604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-42e9d6a1-6c61-4ce2-aaa6-76a2c8633a3f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1725 microversion: 2.1 time: 0.170702 May 17 22:13:35.682169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 359/746] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:35 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:36.144771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0cef2239-8f3f-4e3d-8157-14ce44034d42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:36.145288 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0cef2239-8f3f-4e3d-8157-14ce44034d42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:36.151602 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0cef2239-8f3f-4e3d-8157-14ce44034d42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:36.152036 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0cef2239-8f3f-4e3d-8157-14ce44034d42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:36.152785 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0cef2239-8f3f-4e3d-8157-14ce44034d42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:36.153208 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0cef2239-8f3f-4e3d-8157-14ce44034d42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:36.306024 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0cef2239-8f3f-4e3d-8157-14ce44034d42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:36.314828 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0cef2239-8f3f-4e3d-8157-14ce44034d42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.174500 May 17 22:13:36.333328 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 388/747] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:36 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:36.642971 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1e512e7b-000c-445d-aa86-f7a07d979566 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:36.643619 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1e512e7b-000c-445d-aa86-f7a07d979566 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:36.650017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e512e7b-000c-445d-aa86-f7a07d979566 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:36.650464 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e512e7b-000c-445d-aa86-f7a07d979566 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:36.651245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e512e7b-000c-445d-aa86-f7a07d979566 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:36.651679 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1e512e7b-000c-445d-aa86-f7a07d979566 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:36.699198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-56d698a8-f12d-4fe9-86c3-b9dc76b664da tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:36.699801 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-56d698a8-f12d-4fe9-86c3-b9dc76b664da tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:36.705738 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-56d698a8-f12d-4fe9-86c3-b9dc76b664da tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:36.706187 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-56d698a8-f12d-4fe9-86c3-b9dc76b664da tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:36.706945 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-56d698a8-f12d-4fe9-86c3-b9dc76b664da tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:36.707403 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-56d698a8-f12d-4fe9-86c3-b9dc76b664da tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:36.717436 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1e512e7b-000c-445d-aa86-f7a07d979566 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:36.724953 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1e512e7b-000c-445d-aa86-f7a07d979566 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1245 microversion: 2.1 time: 0.085879 May 17 22:13:36.725528 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 360/748] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:36 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:36.832693 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-56d698a8-f12d-4fe9-86c3-b9dc76b664da tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:36.840716 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-56d698a8-f12d-4fe9-86c3-b9dc76b664da tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1725 microversion: 2.1 time: 0.145316 May 17 22:13:36.841317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 389/749] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:36 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:37.348301 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2c248d7e-c771-48d2-8b0a-eb94f5eb707d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:37.348911 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2c248d7e-c771-48d2-8b0a-eb94f5eb707d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:37.354891 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2c248d7e-c771-48d2-8b0a-eb94f5eb707d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:37.355366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2c248d7e-c771-48d2-8b0a-eb94f5eb707d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:37.356250 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2c248d7e-c771-48d2-8b0a-eb94f5eb707d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:37.356718 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2c248d7e-c771-48d2-8b0a-eb94f5eb707d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:37.502298 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2c248d7e-c771-48d2-8b0a-eb94f5eb707d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:37.510006 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2c248d7e-c771-48d2-8b0a-eb94f5eb707d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.165554 May 17 22:13:37.510600 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 361/750] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:37 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:37.743267 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-49336081-2d6d-46da-b888-f9180c10d7d1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:37.743267 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-49336081-2d6d-46da-b888-f9180c10d7d1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:37.749295 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-49336081-2d6d-46da-b888-f9180c10d7d1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:37.749751 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-49336081-2d6d-46da-b888-f9180c10d7d1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:37.751057 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-49336081-2d6d-46da-b888-f9180c10d7d1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:37.751668 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-49336081-2d6d-46da-b888-f9180c10d7d1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:37.818806 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-49336081-2d6d-46da-b888-f9180c10d7d1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:37.826170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-49336081-2d6d-46da-b888-f9180c10d7d1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1245 microversion: 2.1 time: 0.087991 May 17 22:13:37.826736 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 390/751] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:37 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:37.858627 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4c4e50a1-1453-4880-9745-fa0010c88f94 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:37.860036 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4c4e50a1-1453-4880-9745-fa0010c88f94 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:37.867820 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c4e50a1-1453-4880-9745-fa0010c88f94 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:37.868370 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c4e50a1-1453-4880-9745-fa0010c88f94 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:37.869241 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c4e50a1-1453-4880-9745-fa0010c88f94 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:37.869683 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c4e50a1-1453-4880-9745-fa0010c88f94 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:38.006060 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4c4e50a1-1453-4880-9745-fa0010c88f94 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:38.013839 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4c4e50a1-1453-4880-9745-fa0010c88f94 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1725 microversion: 2.1 time: 0.159588 May 17 22:13:38.014411 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 362/752] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:37 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:38.527875 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-036e31ad-85ab-428c-a326-4d2039c90e0d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:38.528475 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-036e31ad-85ab-428c-a326-4d2039c90e0d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:38.534823 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-036e31ad-85ab-428c-a326-4d2039c90e0d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:38.535298 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-036e31ad-85ab-428c-a326-4d2039c90e0d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:38.536059 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-036e31ad-85ab-428c-a326-4d2039c90e0d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:38.536488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-036e31ad-85ab-428c-a326-4d2039c90e0d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:38.739861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-036e31ad-85ab-428c-a326-4d2039c90e0d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:38.748311 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-036e31ad-85ab-428c-a326-4d2039c90e0d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.224211 May 17 22:13:38.748932 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 391/753] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:38 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:38.843568 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0c4d8607-c85d-4741-a68d-c1a28ad0e48d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:38.844722 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0c4d8607-c85d-4741-a68d-c1a28ad0e48d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:38.850983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0c4d8607-c85d-4741-a68d-c1a28ad0e48d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:38.852154 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0c4d8607-c85d-4741-a68d-c1a28ad0e48d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:38.852473 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0c4d8607-c85d-4741-a68d-c1a28ad0e48d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:38.852857 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0c4d8607-c85d-4741-a68d-c1a28ad0e48d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:38.918803 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0c4d8607-c85d-4741-a68d-c1a28ad0e48d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:38.926959 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0c4d8607-c85d-4741-a68d-c1a28ad0e48d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1237 microversion: 2.1 time: 0.087331 May 17 22:13:38.927497 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 363/754] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:38 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:39.030565 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-df99af86-4e6f-40b7-834c-7a564c00c532 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:39.031247 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-df99af86-4e6f-40b7-834c-7a564c00c532 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:39.037070 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df99af86-4e6f-40b7-834c-7a564c00c532 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:39.037665 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df99af86-4e6f-40b7-834c-7a564c00c532 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:39.038427 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df99af86-4e6f-40b7-834c-7a564c00c532 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:39.038853 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-df99af86-4e6f-40b7-834c-7a564c00c532 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:39.167471 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-df99af86-4e6f-40b7-834c-7a564c00c532 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:39.176275 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-df99af86-4e6f-40b7-834c-7a564c00c532 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1725 microversion: 2.1 time: 0.149618 May 17 22:13:39.176831 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 392/755] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:39 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:39.772822 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f4fd51e4-f2d2-4ab9-bbca-98a549db293a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:39.773472 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f4fd51e4-f2d2-4ab9-bbca-98a549db293a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:39.780001 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4fd51e4-f2d2-4ab9-bbca-98a549db293a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:39.780451 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4fd51e4-f2d2-4ab9-bbca-98a549db293a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:39.781870 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4fd51e4-f2d2-4ab9-bbca-98a549db293a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:39.782322 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f4fd51e4-f2d2-4ab9-bbca-98a549db293a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:39.930274 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f4fd51e4-f2d2-4ab9-bbca-98a549db293a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:39.939384 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f4fd51e4-f2d2-4ab9-bbca-98a549db293a tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.170450 May 17 22:13:39.939964 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 364/756] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:39 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:39.950460 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d2928677-4219-4b38-96ac-a8d3c30f8bcb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:39.951212 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d2928677-4219-4b38-96ac-a8d3c30f8bcb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:39.958315 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2928677-4219-4b38-96ac-a8d3c30f8bcb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:39.959012 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2928677-4219-4b38-96ac-a8d3c30f8bcb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:39.959814 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2928677-4219-4b38-96ac-a8d3c30f8bcb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:39.960250 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2928677-4219-4b38-96ac-a8d3c30f8bcb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:40.024603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d2928677-4219-4b38-96ac-a8d3c30f8bcb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:40.032529 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d2928677-4219-4b38-96ac-a8d3c30f8bcb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1237 microversion: 2.1 time: 0.085845 May 17 22:13:40.033096 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 393/757] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:39 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:40.193489 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-47af8bf0-9805-490b-b41f-3aace9e993e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:40.194088 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-47af8bf0-9805-490b-b41f-3aace9e993e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:40.199746 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-47af8bf0-9805-490b-b41f-3aace9e993e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:40.200185 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-47af8bf0-9805-490b-b41f-3aace9e993e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:40.200937 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-47af8bf0-9805-490b-b41f-3aace9e993e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:40.201367 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-47af8bf0-9805-490b-b41f-3aace9e993e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:40.328209 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-47af8bf0-9805-490b-b41f-3aace9e993e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:40.336016 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-47af8bf0-9805-490b-b41f-3aace9e993e6 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1725 microversion: 2.1 time: 0.146442 May 17 22:13:40.339959 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 365/758] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:40 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:40.956719 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b4429973-d432-4da8-8767-b5c84d52ba47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:40.957322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b4429973-d432-4da8-8767-b5c84d52ba47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:40.963629 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b4429973-d432-4da8-8767-b5c84d52ba47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:40.964071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b4429973-d432-4da8-8767-b5c84d52ba47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:40.964829 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b4429973-d432-4da8-8767-b5c84d52ba47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:40.965259 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b4429973-d432-4da8-8767-b5c84d52ba47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:41.049843 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-86985641-606a-43d1-b043-97b400bbd070 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:41.050489 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-86985641-606a-43d1-b043-97b400bbd070 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:41.057031 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86985641-606a-43d1-b043-97b400bbd070 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:41.057487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86985641-606a-43d1-b043-97b400bbd070 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:41.058257 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86985641-606a-43d1-b043-97b400bbd070 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:41.058692 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-86985641-606a-43d1-b043-97b400bbd070 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:41.130757 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-86985641-606a-43d1-b043-97b400bbd070 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:41.135986 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b4429973-d432-4da8-8767-b5c84d52ba47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:41.138849 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-86985641-606a-43d1-b043-97b400bbd070 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1237 microversion: 2.1 time: 0.093426 May 17 22:13:41.139513 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 366/759] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:41 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:41.144786 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b4429973-d432-4da8-8767-b5c84d52ba47 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1756 microversion: 2.1 time: 0.191899 May 17 22:13:41.148567 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 394/760] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:40 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:41.353073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eecb8d48-d50a-48d8-a744-ff812dc7c388 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:41.353736 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eecb8d48-d50a-48d8-a744-ff812dc7c388 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:41.359720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eecb8d48-d50a-48d8-a744-ff812dc7c388 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:41.360155 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eecb8d48-d50a-48d8-a744-ff812dc7c388 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:41.361010 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eecb8d48-d50a-48d8-a744-ff812dc7c388 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:41.361449 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eecb8d48-d50a-48d8-a744-ff812dc7c388 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:41.491518 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-eecb8d48-d50a-48d8-a744-ff812dc7c388 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:41.499346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eecb8d48-d50a-48d8-a744-ff812dc7c388 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1725 microversion: 2.1 time: 0.150094 May 17 22:13:41.499923 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 367/761] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:41 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:42.156131 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1d265185-8b5c-47ec-9b86-ee1aad6ef153 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:42.156788 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1d265185-8b5c-47ec-9b86-ee1aad6ef153 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:42.165810 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d265185-8b5c-47ec-9b86-ee1aad6ef153 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:42.166260 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d265185-8b5c-47ec-9b86-ee1aad6ef153 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:42.167045 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d265185-8b5c-47ec-9b86-ee1aad6ef153 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:42.167705 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1d265185-8b5c-47ec-9b86-ee1aad6ef153 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:42.176990 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1fc2099c-4ca2-459d-b5a2-ba0b43092c0c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:42.179503 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1fc2099c-4ca2-459d-b5a2-ba0b43092c0c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:42.193998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1fc2099c-4ca2-459d-b5a2-ba0b43092c0c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:42.193998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1fc2099c-4ca2-459d-b5a2-ba0b43092c0c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:42.193998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1fc2099c-4ca2-459d-b5a2-ba0b43092c0c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:42.193998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1fc2099c-4ca2-459d-b5a2-ba0b43092c0c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:42.235091 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1d265185-8b5c-47ec-9b86-ee1aad6ef153 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:42.243763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1d265185-8b5c-47ec-9b86-ee1aad6ef153 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1293 microversion: 2.1 time: 0.091364 May 17 22:13:42.244789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 395/762] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:42 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:42.353791 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1fc2099c-4ca2-459d-b5a2-ba0b43092c0c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:42.362742 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1fc2099c-4ca2-459d-b5a2-ba0b43092c0c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1759 microversion: 2.1 time: 0.203803 May 17 22:13:42.363561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 368/763] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:42 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1759 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:42.518001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a764a6f2-27b2-4353-9e4f-48474901a078 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:42.518409 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a764a6f2-27b2-4353-9e4f-48474901a078 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:42.524433 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a764a6f2-27b2-4353-9e4f-48474901a078 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:42.524888 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a764a6f2-27b2-4353-9e4f-48474901a078 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:42.525722 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a764a6f2-27b2-4353-9e4f-48474901a078 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:42.526161 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a764a6f2-27b2-4353-9e4f-48474901a078 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:42.708532 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a764a6f2-27b2-4353-9e4f-48474901a078 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:42.719833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a764a6f2-27b2-4353-9e4f-48474901a078 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1731 microversion: 2.1 time: 0.205854 May 17 22:13:42.726153 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 396/764] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:42 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:42.739316 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d1c27098-30d2-4cd5-9e0a-4df5db90567e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:42.739992 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d1c27098-30d2-4cd5-9e0a-4df5db90567e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:42.746142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1c27098-30d2-4cd5-9e0a-4df5db90567e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:42.746597 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1c27098-30d2-4cd5-9e0a-4df5db90567e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:42.747459 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1c27098-30d2-4cd5-9e0a-4df5db90567e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:42.747901 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1c27098-30d2-4cd5-9e0a-4df5db90567e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:42.870369 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d1c27098-30d2-4cd5-9e0a-4df5db90567e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135600 May 17 22:13:42.871008 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 369/765] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 17 22:13:42 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:43.261461 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4a88931d-0967-4311-81ab-38989c415364 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:43.262067 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4a88931d-0967-4311-81ab-38989c415364 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:43.269405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a88931d-0967-4311-81ab-38989c415364 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:43.269849 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a88931d-0967-4311-81ab-38989c415364 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:43.270800 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a88931d-0967-4311-81ab-38989c415364 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:43.271430 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a88931d-0967-4311-81ab-38989c415364 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:43.347699 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4a88931d-0967-4311-81ab-38989c415364 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:43.360489 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4a88931d-0967-4311-81ab-38989c415364 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1299 microversion: 2.1 time: 0.102820 May 17 22:13:43.361890 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 397/766] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:43 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:43.898894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-df32e123-3dda-4a52-aeac-3b58959622a2 req-a038266b-9111-47d9-a0f6-3aa668ba158f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3e521e-c843-4727-8c31-00c86e4e6aa0", "tag": "ea82fbfe-827c-4d08-a78d-a544d7f86c1c"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:43.913872 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-df32e123-3dda-4a52-aeac-3b58959622a2 req-a038266b-9111-47d9-a0f6-3aa668ba158f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:43.914590 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-df32e123-3dda-4a52-aeac-3b58959622a2 req-a038266b-9111-47d9-a0f6-3aa668ba158f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:43.927217 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-df32e123-3dda-4a52-aeac-3b58959622a2 req-a038266b-9111-47d9-a0f6-3aa668ba158f service nova] Creating event network-changed:ea82fbfe-827c-4d08-a78d-a544d7f86c1c for instance da3e521e-c843-4727-8c31-00c86e4e6aa0 on hv-cinder-83998 May 17 22:13:43.932986 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-df32e123-3dda-4a52-aeac-3b58959622a2 req-a038266b-9111-47d9-a0f6-3aa668ba158f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047725 May 17 22:13:43.933887 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 370/767] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:44.378450 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-61c9d29f-f225-41c5-8739-82f8d1665af0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:44.379060 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-61c9d29f-f225-41c5-8739-82f8d1665af0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:44.386564 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61c9d29f-f225-41c5-8739-82f8d1665af0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:44.387017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61c9d29f-f225-41c5-8739-82f8d1665af0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:44.387841 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61c9d29f-f225-41c5-8739-82f8d1665af0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:44.388277 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61c9d29f-f225-41c5-8739-82f8d1665af0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:44.695863 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-61c9d29f-f225-41c5-8739-82f8d1665af0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:44.703808 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-61c9d29f-f225-41c5-8739-82f8d1665af0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1367 microversion: 2.1 time: 0.329840 May 17 22:13:44.705071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 398/768] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:44 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:45.023321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-17cace6b-2842-4b6a-baaa-739e1320db60 req-513167bd-e4e9-4e0b-a5a3-42068641086f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3dd261-a8e5-4aa9-a950-77e2ce94cc45", "tag": "d038f455-52e9-4943-8fef-3e82a226e892"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:45.033602 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-17cace6b-2842-4b6a-baaa-739e1320db60 req-513167bd-e4e9-4e0b-a5a3-42068641086f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:45.035173 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-17cace6b-2842-4b6a-baaa-739e1320db60 req-513167bd-e4e9-4e0b-a5a3-42068641086f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:45.045876 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-17cace6b-2842-4b6a-baaa-739e1320db60 req-513167bd-e4e9-4e0b-a5a3-42068641086f service nova] Creating event network-changed:d038f455-52e9-4943-8fef-3e82a226e892 for instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 on hv-cinder-83998 May 17 22:13:45.051254 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-17cace6b-2842-4b6a-baaa-739e1320db60 req-513167bd-e4e9-4e0b-a5a3-42068641086f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037537 May 17 22:13:45.052665 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 371/769] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:45.410932 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2e084243-f434-45bc-9c1f-0dea2be40c69 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:45.411600 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2e084243-f434-45bc-9c1f-0dea2be40c69 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:45.418293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2e084243-f434-45bc-9c1f-0dea2be40c69 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:45.418740 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2e084243-f434-45bc-9c1f-0dea2be40c69 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:45.419546 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2e084243-f434-45bc-9c1f-0dea2be40c69 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:45.419979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2e084243-f434-45bc-9c1f-0dea2be40c69 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:45.503417 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-2e084243-f434-45bc-9c1f-0dea2be40c69 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lazy-loading 'services' on Instance uuid b91ceec7-4d65-407e-b85f-da561fe693a2 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:13:45.720803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2e084243-f434-45bc-9c1f-0dea2be40c69 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2/os-volume_attachments/3206f9be-9852-4386-a697-dbab5f602672" status: 202 len: 0 microversion: 2.1 time: 0.314044 May 17 22:13:45.721345 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-41aa7a66-ca05-47f6-8215-cb54d24f1143 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:45.722284 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-41aa7a66-ca05-47f6-8215-cb54d24f1143 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:45.731494 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 399/770] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 17 22:13:45 2022] DELETE /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2/os-volume_attachments/3206f9be-9852-4386-a697-dbab5f602672 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:13:45.738586 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41aa7a66-ca05-47f6-8215-cb54d24f1143 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:45.738975 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41aa7a66-ca05-47f6-8215-cb54d24f1143 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:45.740996 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41aa7a66-ca05-47f6-8215-cb54d24f1143 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:45.741438 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-41aa7a66-ca05-47f6-8215-cb54d24f1143 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:45.900144 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-41aa7a66-ca05-47f6-8215-cb54d24f1143 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:45.912613 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-41aa7a66-ca05-47f6-8215-cb54d24f1143 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1367 microversion: 2.1 time: 0.195829 May 17 22:13:45.913805 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 372/771] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:45 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:45.952322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-c1136ecd-6788-4319-b9a0-d4f25eafeb64 req-c515e21b-a62f-4d61-90f2-0ab644d0fa64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3e521e-c843-4727-8c31-00c86e4e6aa0", "tag": "ea82fbfe-827c-4d08-a78d-a544d7f86c1c"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:45.960994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c1136ecd-6788-4319-b9a0-d4f25eafeb64 req-c515e21b-a62f-4d61-90f2-0ab644d0fa64 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:45.961442 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c1136ecd-6788-4319-b9a0-d4f25eafeb64 req-c515e21b-a62f-4d61-90f2-0ab644d0fa64 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:45.973193 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-c1136ecd-6788-4319-b9a0-d4f25eafeb64 req-c515e21b-a62f-4d61-90f2-0ab644d0fa64 service nova] Creating event network-changed:ea82fbfe-827c-4d08-a78d-a544d7f86c1c for instance da3e521e-c843-4727-8c31-00c86e4e6aa0 on hv-cinder-83998 May 17 22:13:45.978083 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-c1136ecd-6788-4319-b9a0-d4f25eafeb64 req-c515e21b-a62f-4d61-90f2-0ab644d0fa64 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029864 May 17 22:13:45.978669 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 400/772] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:46.930927 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2033a4d6-f5d2-4d48-8884-12bdeae1c32a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:46.931567 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2033a4d6-f5d2-4d48-8884-12bdeae1c32a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:46.942299 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2033a4d6-f5d2-4d48-8884-12bdeae1c32a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:46.942745 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2033a4d6-f5d2-4d48-8884-12bdeae1c32a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:46.943628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2033a4d6-f5d2-4d48-8884-12bdeae1c32a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:46.944061 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2033a4d6-f5d2-4d48-8884-12bdeae1c32a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:47.092477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2033a4d6-f5d2-4d48-8884-12bdeae1c32a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:47.100992 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2033a4d6-f5d2-4d48-8884-12bdeae1c32a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1367 microversion: 2.1 time: 0.174319 May 17 22:13:47.101643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 373/773] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:46 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:48.117802 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-cf951db9-99b1-4207-859f-19b79b66f2fc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:48.118504 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-cf951db9-99b1-4207-859f-19b79b66f2fc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:48.125014 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cf951db9-99b1-4207-859f-19b79b66f2fc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:48.125472 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cf951db9-99b1-4207-859f-19b79b66f2fc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:48.126902 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cf951db9-99b1-4207-859f-19b79b66f2fc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:48.127527 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-cf951db9-99b1-4207-859f-19b79b66f2fc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:48.264876 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-cf951db9-99b1-4207-859f-19b79b66f2fc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:48.272452 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-cf951db9-99b1-4207-859f-19b79b66f2fc tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1367 microversion: 2.1 time: 0.158847 May 17 22:13:48.273031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 401/774] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:48 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:49.070519 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f19b068b-c504-4536-9663-a4d5e00c3c24 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:49.071006 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f19b068b-c504-4536-9663-a4d5e00c3c24 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:49.083553 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f19b068b-c504-4536-9663-a4d5e00c3c24 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:49.083553 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f19b068b-c504-4536-9663-a4d5e00c3c24 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:49.083852 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f19b068b-c504-4536-9663-a4d5e00c3c24 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:49.084288 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f19b068b-c504-4536-9663-a4d5e00c3c24 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:49.111160 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f19b068b-c504-4536-9663-a4d5e00c3c24 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:13:49.295225 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-346af0c9-4fb3-4bbf-9e82-6fb27d67e67f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:49.295841 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-346af0c9-4fb3-4bbf-9e82-6fb27d67e67f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:49.302992 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-346af0c9-4fb3-4bbf-9e82-6fb27d67e67f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:49.306127 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-346af0c9-4fb3-4bbf-9e82-6fb27d67e67f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:49.306127 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-346af0c9-4fb3-4bbf-9e82-6fb27d67e67f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:49.306127 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-346af0c9-4fb3-4bbf-9e82-6fb27d67e67f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:49.355565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f19b068b-c504-4536-9663-a4d5e00c3c24 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 204 len: 0 microversion: 2.1 time: 0.287875 May 17 22:13:49.356190 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 374/775] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:13:49 2022] DELETE /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:13:49.368148 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9ae0af49-9e0e-4843-98ee-a981d63f016d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:49.368985 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9ae0af49-9e0e-4843-98ee-a981d63f016d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:49.375081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ae0af49-9e0e-4843-98ee-a981d63f016d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:49.375577 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ae0af49-9e0e-4843-98ee-a981d63f016d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:49.376958 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ae0af49-9e0e-4843-98ee-a981d63f016d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:49.377395 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9ae0af49-9e0e-4843-98ee-a981d63f016d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:49.475477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-346af0c9-4fb3-4bbf-9e82-6fb27d67e67f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:49.482683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-346af0c9-4fb3-4bbf-9e82-6fb27d67e67f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1367 microversion: 2.1 time: 0.192505 May 17 22:13:49.483261 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 402/776] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:49 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:49.528282 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9ae0af49-9e0e-4843-98ee-a981d63f016d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:49.536313 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9ae0af49-9e0e-4843-98ee-a981d63f016d tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1514 microversion: 2.1 time: 0.172544 May 17 22:13:49.536888 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 375/777] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:49 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:50.499963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4027c5ef-606a-49a0-9b09-d9a1e7ddb286 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:50.502088 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4027c5ef-606a-49a0-9b09-d9a1e7ddb286 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:50.509250 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4027c5ef-606a-49a0-9b09-d9a1e7ddb286 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:50.509964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4027c5ef-606a-49a0-9b09-d9a1e7ddb286 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:50.510867 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4027c5ef-606a-49a0-9b09-d9a1e7ddb286 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:50.511343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4027c5ef-606a-49a0-9b09-d9a1e7ddb286 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:50.553609 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a2ca971d-7b6a-442d-9cc0-376615ef8fcc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:50.554404 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a2ca971d-7b6a-442d-9cc0-376615ef8fcc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:50.561202 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a2ca971d-7b6a-442d-9cc0-376615ef8fcc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:50.561642 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a2ca971d-7b6a-442d-9cc0-376615ef8fcc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:50.562406 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a2ca971d-7b6a-442d-9cc0-376615ef8fcc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:50.562837 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a2ca971d-7b6a-442d-9cc0-376615ef8fcc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:50.693445 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4027c5ef-606a-49a0-9b09-d9a1e7ddb286 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:50.700732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4027c5ef-606a-49a0-9b09-d9a1e7ddb286 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1367 microversion: 2.1 time: 0.204762 May 17 22:13:50.701327 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 403/778] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:50 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:50.719027 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a2ca971d-7b6a-442d-9cc0-376615ef8fcc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:50.727019 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a2ca971d-7b6a-442d-9cc0-376615ef8fcc tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1514 microversion: 2.1 time: 0.177326 May 17 22:13:50.727613 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 376/779] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:50 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:51.160103 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-5a9d9dd2-967c-43ef-938e-62b378aedc5a req-e2828a4a-3752-49b2-9402-72cb39e3900b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3dd261-a8e5-4aa9-a950-77e2ce94cc45", "name": "network-vif-plugged", "status": "completed", "tag": "d038f455-52e9-4943-8fef-3e82a226e892"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:51.167952 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-5a9d9dd2-967c-43ef-938e-62b378aedc5a req-e2828a4a-3752-49b2-9402-72cb39e3900b service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:51.168392 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-5a9d9dd2-967c-43ef-938e-62b378aedc5a req-e2828a4a-3752-49b2-9402-72cb39e3900b service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:51.178818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-5a9d9dd2-967c-43ef-938e-62b378aedc5a req-e2828a4a-3752-49b2-9402-72cb39e3900b service nova] Creating event network-vif-plugged:d038f455-52e9-4943-8fef-3e82a226e892 for instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 on hv-cinder-83998 May 17 22:13:51.183752 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-5a9d9dd2-967c-43ef-938e-62b378aedc5a req-e2828a4a-3752-49b2-9402-72cb39e3900b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027328 May 17 22:13:51.184334 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 404/780] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:51.719608 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8bee79a5-b83a-4d01-bf72-ab0332ce5b90 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:51.721041 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8bee79a5-b83a-4d01-bf72-ab0332ce5b90 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:51.730416 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8bee79a5-b83a-4d01-bf72-ab0332ce5b90 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:51.730860 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8bee79a5-b83a-4d01-bf72-ab0332ce5b90 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:51.731732 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8bee79a5-b83a-4d01-bf72-ab0332ce5b90 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:51.732166 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8bee79a5-b83a-4d01-bf72-ab0332ce5b90 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:51.745334 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2c8fe1f5-fd32-476b-9574-f6a3caf9edaf tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:51.753181 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2c8fe1f5-fd32-476b-9574-f6a3caf9edaf tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:51.753654 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2c8fe1f5-fd32-476b-9574-f6a3caf9edaf tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:51.754104 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2c8fe1f5-fd32-476b-9574-f6a3caf9edaf tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:51.754880 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2c8fe1f5-fd32-476b-9574-f6a3caf9edaf tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:51.755346 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2c8fe1f5-fd32-476b-9574-f6a3caf9edaf tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:52.185425 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8bee79a5-b83a-4d01-bf72-ab0332ce5b90 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:52.195171 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8bee79a5-b83a-4d01-bf72-ab0332ce5b90 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1367 microversion: 2.1 time: 0.480814 May 17 22:13:52.196290 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 377/781] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:51 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:52.229204 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2c8fe1f5-fd32-476b-9574-f6a3caf9edaf tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:52.236894 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2c8fe1f5-fd32-476b-9574-f6a3caf9edaf tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1514 microversion: 2.1 time: 0.496524 May 17 22:13:52.237557 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 405/782] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:51 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1514 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:52.469156 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-6668e32f-3400-46c2-8677-2d4ae77b897c req-0ed17f45-2457-4f36-879b-15b7a98cfd06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91ceec7-4d65-407e-b85f-da561fe693a2", "name": "network-vif-deleted", "tag": "c018dbd8-fb54-4a5e-a5b1-3aa16ddebbc8"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:52.476973 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-6668e32f-3400-46c2-8677-2d4ae77b897c req-0ed17f45-2457-4f36-879b-15b7a98cfd06 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:52.477461 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-6668e32f-3400-46c2-8677-2d4ae77b897c req-0ed17f45-2457-4f36-879b-15b7a98cfd06 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:52.489488 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-6668e32f-3400-46c2-8677-2d4ae77b897c req-0ed17f45-2457-4f36-879b-15b7a98cfd06 service nova] Creating event network-vif-deleted:c018dbd8-fb54-4a5e-a5b1-3aa16ddebbc8 for instance b91ceec7-4d65-407e-b85f-da561fe693a2 on hv-cinder-83998 May 17 22:13:52.494613 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-6668e32f-3400-46c2-8677-2d4ae77b897c req-0ed17f45-2457-4f36-879b-15b7a98cfd06 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029157 May 17 22:13:52.495479 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 378/783] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:53.212863 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8a2faa16-a95e-44a7-a361-38df4d332de8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:53.213449 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8a2faa16-a95e-44a7-a361-38df4d332de8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:53.220515 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8a2faa16-a95e-44a7-a361-38df4d332de8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:53.220964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8a2faa16-a95e-44a7-a361-38df4d332de8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:53.221718 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8a2faa16-a95e-44a7-a361-38df4d332de8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:53.222189 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8a2faa16-a95e-44a7-a361-38df4d332de8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:53.256219 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6b2071cc-5c40-4f8e-a37a-6c395157b6c3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:53.257127 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6b2071cc-5c40-4f8e-a37a-6c395157b6c3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:53.263739 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b2071cc-5c40-4f8e-a37a-6c395157b6c3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:53.264306 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b2071cc-5c40-4f8e-a37a-6c395157b6c3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:53.265091 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b2071cc-5c40-4f8e-a37a-6c395157b6c3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:53.265523 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b2071cc-5c40-4f8e-a37a-6c395157b6c3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:53.297111 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b2071cc-5c40-4f8e-a37a-6c395157b6c3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:53.297571 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b2071cc-5c40-4f8e-a37a-6c395157b6c3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:53.298031 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-6b2071cc-5c40-4f8e-a37a-6c395157b6c3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lazy-loading 'fault' on Instance uuid b91ceec7-4d65-407e-b85f-da561fe693a2 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:13:53.347980 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6b2071cc-5c40-4f8e-a37a-6c395157b6c3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f1a5f6023e47c8b84edab34b308094', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c1c0a74d6a4392947ee727aa1d3da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:53.357099 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6b2071cc-5c40-4f8e-a37a-6c395157b6c3 tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 200 len: 1309 microversion: 2.1 time: 0.105876 May 17 22:13:53.357689 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 379/784] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:53 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:13:53.382085 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8a2faa16-a95e-44a7-a361-38df4d332de8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:53.389465 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8a2faa16-a95e-44a7-a361-38df4d332de8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1367 microversion: 2.1 time: 0.180490 May 17 22:13:53.390032 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 406/785] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:53 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:54.375282 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d3903333-2119-4754-b031-8d15003a03ad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:54.376866 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d3903333-2119-4754-b031-8d15003a03ad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] [instance: b91ceec7-4d65-407e-b85f-da561fe693a2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:54.383427 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3903333-2119-4754-b031-8d15003a03ad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:54.383877 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3903333-2119-4754-b031-8d15003a03ad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:54.384635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3903333-2119-4754-b031-8d15003a03ad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:54.385062 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d3903333-2119-4754-b031-8d15003a03ad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:54.398889 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-d3903333-2119-4754-b031-8d15003a03ad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] HTTP exception thrown: Instance b91ceec7-4d65-407e-b85f-da561fe693a2 could not be found. May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d3903333-2119-4754-b031-8d15003a03ad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Request method failure captured: May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 HTTP/1.1 May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB1utMyXq5LiOrNqcnyb8gvKm24hn8Ajzg6igYG2VQT-PlVOJQCAIKv2XGApT7FpAC4HPBrL01sTMOrAjke6llEczV9PLhGgX_IvnrP6VyBmVX6H7EWJGsh8AIryvUPsMv3-D7yjGrtbcJeqN2Zb_v4dTB45qdV6831EOsmPOhxtzpo May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 93c1c0a74d6a4392947ee727aa1d3da3 May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-VolumesSnapshotTestJSON-361954781 May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:13:54.400544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:13:54.402201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/93c1c0a74d6a4392947ee727aa1d3da3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_93c1c0a74d6a4392947ee727aa1d3da3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/93c1c0a74d6a4392947ee727aa1d3da3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/93c1c0a74d6a4392947ee727aa1d3da3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:13:54.402201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-VolumesSnapshotTestJSON-361954781 May 17 22:13:54.402201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 93c1c0a74d6a4392947ee727aa1d3da3 May 17 22:13:54.402201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-361954781 May 17 22:13:54.402201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-VolumesSnapshotTestJSON-361954781-project May 17 22:13:54.402201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:13:54.402201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:13:54.402201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 98f1a5f6023e47c8b84edab34b308094 May 17 22:13:54.402201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-VolumesSnapshotTestJSON-361954781-project May 17 22:13:54.402201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:13:54.402201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance b91ceec7-4d65-407e-b85f-da561fe693a2 could not be found. May 17 22:13:54.402201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': 'b91ceec7-4d65-407e-b85f-da561fe693a2'} May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91ceec7-4d65-407e-b85f-da561fe693a2 could not be found. May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:13:54.403063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91ceec7-4d65-407e-b85f-da561fe693a2 could not be found. May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91ceec7-4d65-407e-b85f-da561fe693a2 could not be found. May 17 22:13:54.404607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:13:54.405840 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d3903333-2119-4754-b031-8d15003a03ad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] Returning 404 to user: Instance b91ceec7-4d65-407e-b85f-da561fe693a2 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:13:54.405840 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d3903333-2119-4754-b031-8d15003a03ad tempest-VolumesSnapshotTestJSON-361954781 tempest-VolumesSnapshotTestJSON-361954781-project] 10.222.0.24 "GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2" status: 404 len: 111 microversion: 2.1 time: 0.030860 May 17 22:13:54.405840 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 380/786] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:54 2022] GET /compute/v2.1/servers/b91ceec7-4d65-407e-b85f-da561fe693a2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:13:54.409730 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-435eee1e-e518-485e-a869-6de5c3cbf11e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:54.410720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-435eee1e-e518-485e-a869-6de5c3cbf11e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:54.417529 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-435eee1e-e518-485e-a869-6de5c3cbf11e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:54.417970 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-435eee1e-e518-485e-a869-6de5c3cbf11e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:54.418786 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-435eee1e-e518-485e-a869-6de5c3cbf11e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:54.419255 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-435eee1e-e518-485e-a869-6de5c3cbf11e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:54.546891 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-435eee1e-e518-485e-a869-6de5c3cbf11e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:13:54.554727 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-435eee1e-e518-485e-a869-6de5c3cbf11e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1558 microversion: 2.1 time: 0.152836 May 17 22:13:54.555320 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 407/787] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:13:54 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:13:54.571835 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a3fd7777-9337-489e-8fd3-b8e45e893fa8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:54.572331 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a3fd7777-9337-489e-8fd3-b8e45e893fa8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:54.578764 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3fd7777-9337-489e-8fd3-b8e45e893fa8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:54.579315 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3fd7777-9337-489e-8fd3-b8e45e893fa8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:54.580216 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3fd7777-9337-489e-8fd3-b8e45e893fa8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:54.580627 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3fd7777-9337-489e-8fd3-b8e45e893fa8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:54.661736 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a3fd7777-9337-489e-8fd3-b8e45e893fa8 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093760 May 17 22:13:54.662327 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 381/788] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 17 22:13:54 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:55.964552 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-21a7d69f-e6df-4d4b-93f8-9c8b2e58ac89 req-5a3206f4-ff44-4839-93b4-bc6620e1f532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af3dd261-a8e5-4aa9-a950-77e2ce94cc45", "tag": "d038f455-52e9-4943-8fef-3e82a226e892"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:13:55.973435 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-21a7d69f-e6df-4d4b-93f8-9c8b2e58ac89 req-5a3206f4-ff44-4839-93b4-bc6620e1f532 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:55.973869 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-21a7d69f-e6df-4d4b-93f8-9c8b2e58ac89 req-5a3206f4-ff44-4839-93b4-bc6620e1f532 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:55.984489 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-21a7d69f-e6df-4d4b-93f8-9c8b2e58ac89 req-5a3206f4-ff44-4839-93b4-bc6620e1f532 service nova] Creating event network-changed:d038f455-52e9-4943-8fef-3e82a226e892 for instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 on hv-cinder-83998 May 17 22:13:55.990162 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-21a7d69f-e6df-4d4b-93f8-9c8b2e58ac89 req-5a3206f4-ff44-4839-93b4-bc6620e1f532 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029137 May 17 22:13:55.990790 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 408/789] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:13:59.719510 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e488e8bb-0ccd-4fd2-8b16-3af8e1b23c1d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:59.720047 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e488e8bb-0ccd-4fd2-8b16-3af8e1b23c1d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:59.725943 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e488e8bb-0ccd-4fd2-8b16-3af8e1b23c1d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:59.726386 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e488e8bb-0ccd-4fd2-8b16-3af8e1b23c1d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:59.727171 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e488e8bb-0ccd-4fd2-8b16-3af8e1b23c1d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:59.727603 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e488e8bb-0ccd-4fd2-8b16-3af8e1b23c1d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:59.757048 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e488e8bb-0ccd-4fd2-8b16-3af8e1b23c1d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-volume_attachments/cfe64674-52ce-4e92-ae5a-a0b8b0e82818" status: 200 len: 194 microversion: 2.20 time: 0.042510 May 17 22:13:59.757626 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 382/790] 10.222.0.24 () {60 vars in 1453 bytes} [Tue May 17 22:13:59 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-volume_attachments/cfe64674-52ce-4e92-ae5a-a0b8b0e82818 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:13:59.819755 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-76216a92-5391-4381-a9d8-fc40e3f26f73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:13:59.820326 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-76216a92-5391-4381-a9d8-fc40e3f26f73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:13:59.826328 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76216a92-5391-4381-a9d8-fc40e3f26f73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:59.826768 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76216a92-5391-4381-a9d8-fc40e3f26f73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:59.827551 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76216a92-5391-4381-a9d8-fc40e3f26f73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:13:59.827978 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76216a92-5391-4381-a9d8-fc40e3f26f73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:13:59.907329 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-76216a92-5391-4381-a9d8-fc40e3f26f73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lazy-loading 'services' on Instance uuid 5c568a7b-6b45-45c4-b60a-3514d7c43e6e {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:14:00.101850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-76216a92-5391-4381-a9d8-fc40e3f26f73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-volume_attachments/cfe64674-52ce-4e92-ae5a-a0b8b0e82818" status: 202 len: 0 microversion: 2.20 time: 0.286639 May 17 22:14:00.102461 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 409/791] 10.222.0.24 () {60 vars in 1456 bytes} [Tue May 17 22:13:59 2022] DELETE /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-volume_attachments/cfe64674-52ce-4e92-ae5a-a0b8b0e82818 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 22:14:00.111500 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9a7f26ab-30f9-482a-a155-ff962b5bb8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:00.112908 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9a7f26ab-30f9-482a-a155-ff962b5bb8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:00.118643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9a7f26ab-30f9-482a-a155-ff962b5bb8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:00.119089 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9a7f26ab-30f9-482a-a155-ff962b5bb8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:00.119891 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9a7f26ab-30f9-482a-a155-ff962b5bb8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:00.120320 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9a7f26ab-30f9-482a-a155-ff962b5bb8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:00.150079 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9a7f26ab-30f9-482a-a155-ff962b5bb8c3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043105 May 17 22:14:00.150629 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 383/792] 10.222.0.24 () {60 vars in 1342 bytes} [Tue May 17 22:14:00 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:14:01.164850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-76ab2786-e171-40b1-bcdf-5ad1d469de12 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:01.166443 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-76ab2786-e171-40b1-bcdf-5ad1d469de12 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:01.173658 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76ab2786-e171-40b1-bcdf-5ad1d469de12 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:01.174404 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76ab2786-e171-40b1-bcdf-5ad1d469de12 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:01.175210 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76ab2786-e171-40b1-bcdf-5ad1d469de12 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:01.175640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76ab2786-e171-40b1-bcdf-5ad1d469de12 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:01.208789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-76ab2786-e171-40b1-bcdf-5ad1d469de12 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049630 May 17 22:14:01.209366 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 410/793] 10.222.0.24 () {60 vars in 1342 bytes} [Tue May 17 22:14:01 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:14:02.220509 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d4f3dae6-b9b5-4f8c-91c8-0a0cd225be86 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:02.222493 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d4f3dae6-b9b5-4f8c-91c8-0a0cd225be86 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:02.231067 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d4f3dae6-b9b5-4f8c-91c8-0a0cd225be86 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:02.231550 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d4f3dae6-b9b5-4f8c-91c8-0a0cd225be86 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:02.232321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d4f3dae6-b9b5-4f8c-91c8-0a0cd225be86 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:02.232759 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d4f3dae6-b9b5-4f8c-91c8-0a0cd225be86 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:02.261161 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d4f3dae6-b9b5-4f8c-91c8-0a0cd225be86 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044597 May 17 22:14:02.261713 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 384/794] 10.222.0.24 () {60 vars in 1342 bytes} [Tue May 17 22:14:02 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:02.319607 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bc0ef4b4-82eb-48e7-b673-cc622ed4a245 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:02.320105 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bc0ef4b4-82eb-48e7-b673-cc622ed4a245 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:02.326660 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bc0ef4b4-82eb-48e7-b673-cc622ed4a245 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:02.327124 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bc0ef4b4-82eb-48e7-b673-cc622ed4a245 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:02.327901 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bc0ef4b4-82eb-48e7-b673-cc622ed4a245 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:02.328334 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-bc0ef4b4-82eb-48e7-b673-cc622ed4a245 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:02.366924 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-bc0ef4b4-82eb-48e7-b673-cc622ed4a245 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:14:02.636549 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bc0ef4b4-82eb-48e7-b673-cc622ed4a245 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 204 len: 0 microversion: 2.20 time: 0.320538 May 17 22:14:02.637141 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 411/795] 10.222.0.24 () {60 vars in 1279 bytes} [Tue May 17 22:14:02 2022] DELETE /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 17 22:14:02.645400 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a8b76d2b-8c04-4924-9ad5-54aea05760b7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:02.646000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a8b76d2b-8c04-4924-9ad5-54aea05760b7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:02.652140 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a8b76d2b-8c04-4924-9ad5-54aea05760b7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:02.652594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a8b76d2b-8c04-4924-9ad5-54aea05760b7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:02.653392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a8b76d2b-8c04-4924-9ad5-54aea05760b7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:02.653824 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a8b76d2b-8c04-4924-9ad5-54aea05760b7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:02.945335 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a8b76d2b-8c04-4924-9ad5-54aea05760b7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:02.953775 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a8b76d2b-8c04-4924-9ad5-54aea05760b7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:02.964747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a8b76d2b-8c04-4924-9ad5-54aea05760b7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:02.964747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a8b76d2b-8c04-4924-9ad5-54aea05760b7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.315173 May 17 22:14:02.964747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 385/796] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:02 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:03.978795 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c4d7c7d7-7341-4682-84f1-46cf51cbb6af tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:03.979521 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c4d7c7d7-7341-4682-84f1-46cf51cbb6af tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:03.986176 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4d7c7d7-7341-4682-84f1-46cf51cbb6af tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:03.986627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4d7c7d7-7341-4682-84f1-46cf51cbb6af tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:03.987400 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4d7c7d7-7341-4682-84f1-46cf51cbb6af tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:03.987826 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c4d7c7d7-7341-4682-84f1-46cf51cbb6af tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:04.188436 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c4d7c7d7-7341-4682-84f1-46cf51cbb6af tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:04.199191 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c4d7c7d7-7341-4682-84f1-46cf51cbb6af tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:04.201721 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c4d7c7d7-7341-4682-84f1-46cf51cbb6af tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:04.203023 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c4d7c7d7-7341-4682-84f1-46cf51cbb6af tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.228429 May 17 22:14:04.203659 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 412/797] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:03 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:05.221888 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a64cfeda-7c93-40c9-8c9e-8b6267f284c5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:05.222602 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a64cfeda-7c93-40c9-8c9e-8b6267f284c5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:05.230241 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a64cfeda-7c93-40c9-8c9e-8b6267f284c5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:05.230694 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a64cfeda-7c93-40c9-8c9e-8b6267f284c5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:05.231677 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a64cfeda-7c93-40c9-8c9e-8b6267f284c5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:05.232116 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a64cfeda-7c93-40c9-8c9e-8b6267f284c5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:05.402636 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a64cfeda-7c93-40c9-8c9e-8b6267f284c5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:05.410913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a64cfeda-7c93-40c9-8c9e-8b6267f284c5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:05.422412 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a64cfeda-7c93-40c9-8c9e-8b6267f284c5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:05.422412 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a64cfeda-7c93-40c9-8c9e-8b6267f284c5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1724 microversion: 2.20 time: 0.195935 May 17 22:14:05.422412 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 386/798] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:05 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:05.665331 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-ae36cc39-7ae5-42b2-b6f8-f8a9643475c9 req-a8acfa66-948d-4cec-93f7-ee6e35231e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c568a7b-6b45-45c4-b60a-3514d7c43e6e", "name": "network-vif-deleted", "tag": "501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:05.676586 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-ae36cc39-7ae5-42b2-b6f8-f8a9643475c9 req-a8acfa66-948d-4cec-93f7-ee6e35231e4f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:05.676586 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-ae36cc39-7ae5-42b2-b6f8-f8a9643475c9 req-a8acfa66-948d-4cec-93f7-ee6e35231e4f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:05.686634 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-ae36cc39-7ae5-42b2-b6f8-f8a9643475c9 req-a8acfa66-948d-4cec-93f7-ee6e35231e4f service nova] Creating event network-vif-deleted:501fce5e-184f-4fc4-9d2e-ed4f0c6b8e9e for instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e on hv-cinder-83998 May 17 22:14:05.691550 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-ae36cc39-7ae5-42b2-b6f8-f8a9643475c9 req-a8acfa66-948d-4cec-93f7-ee6e35231e4f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030183 May 17 22:14:05.693428 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 413/799] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:06.436664 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-539e7001-cd34-4377-b73e-ce055a9cff3c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:06.437282 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-539e7001-cd34-4377-b73e-ce055a9cff3c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:06.443555 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-539e7001-cd34-4377-b73e-ce055a9cff3c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:06.444009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-539e7001-cd34-4377-b73e-ce055a9cff3c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:06.444797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-539e7001-cd34-4377-b73e-ce055a9cff3c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:06.445235 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-539e7001-cd34-4377-b73e-ce055a9cff3c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:06.523939 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-539e7001-cd34-4377-b73e-ce055a9cff3c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:06.531993 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-539e7001-cd34-4377-b73e-ce055a9cff3c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:06.533471 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-539e7001-cd34-4377-b73e-ce055a9cff3c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:06.534605 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-539e7001-cd34-4377-b73e-ce055a9cff3c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1367 microversion: 2.20 time: 0.104466 May 17 22:14:06.536338 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 387/800] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:06 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1367 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:07.553386 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-26d533b3-9d86-4409-920e-be118bed5af6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:07.554090 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-26d533b3-9d86-4409-920e-be118bed5af6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:07.560569 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-26d533b3-9d86-4409-920e-be118bed5af6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:07.561287 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-26d533b3-9d86-4409-920e-be118bed5af6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:07.562055 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-26d533b3-9d86-4409-920e-be118bed5af6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:07.562491 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-26d533b3-9d86-4409-920e-be118bed5af6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:07.623016 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-26d533b3-9d86-4409-920e-be118bed5af6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:07.631166 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-26d533b3-9d86-4409-920e-be118bed5af6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:07.632647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-26d533b3-9d86-4409-920e-be118bed5af6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:07.633766 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-26d533b3-9d86-4409-920e-be118bed5af6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1367 microversion: 2.20 time: 0.084608 May 17 22:14:07.634318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 414/801] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:07 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:07.769003 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4804edc1-483d-4a8f-83c3-095e6cef2e3b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:07.770653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4804edc1-483d-4a8f-83c3-095e6cef2e3b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:07.776878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4804edc1-483d-4a8f-83c3-095e6cef2e3b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:07.777323 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4804edc1-483d-4a8f-83c3-095e6cef2e3b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:07.778085 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4804edc1-483d-4a8f-83c3-095e6cef2e3b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:07.778534 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4804edc1-483d-4a8f-83c3-095e6cef2e3b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:07.806981 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4804edc1-483d-4a8f-83c3-095e6cef2e3b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041831 May 17 22:14:07.807784 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 388/802] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:07 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 22:14:07.869238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e05e5ecf-f421-449d-b385-583b33f658e5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:07.869869 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e05e5ecf-f421-449d-b385-583b33f658e5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:07.875813 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e05e5ecf-f421-449d-b385-583b33f658e5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:07.876263 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e05e5ecf-f421-449d-b385-583b33f658e5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:07.877029 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e05e5ecf-f421-449d-b385-583b33f658e5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:07.877462 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e05e5ecf-f421-449d-b385-583b33f658e5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:07.903043 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e05e5ecf-f421-449d-b385-583b33f658e5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:14:08.178946 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e05e5ecf-f421-449d-b385-583b33f658e5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "DELETE /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 204 len: 0 microversion: 2.1 time: 0.313406 May 17 22:14:08.179586 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 415/803] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:14:07 2022] DELETE /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:14:08.187996 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e1ce5cb1-1c91-4ea2-8276-3fe4f7c5956a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:08.188640 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e1ce5cb1-1c91-4ea2-8276-3fe4f7c5956a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:08.195356 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e1ce5cb1-1c91-4ea2-8276-3fe4f7c5956a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:08.195872 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e1ce5cb1-1c91-4ea2-8276-3fe4f7c5956a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:08.196706 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e1ce5cb1-1c91-4ea2-8276-3fe4f7c5956a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:08.197135 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e1ce5cb1-1c91-4ea2-8276-3fe4f7c5956a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:08.322255 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e1ce5cb1-1c91-4ea2-8276-3fe4f7c5956a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:08.329490 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e1ce5cb1-1c91-4ea2-8276-3fe4f7c5956a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1674 microversion: 2.1 time: 0.145669 May 17 22:14:08.330061 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 389/804] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:08 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:08.652709 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:08.653398 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:08.659751 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:08.660204 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:08.661625 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:08.662061 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:08.692052 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:08.692499 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:08.692949 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lazy-loading 'fault' on Instance uuid 5c568a7b-6b45-45c4-b60a-3514d7c43e6e {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:14:08.827975 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:08.836366 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:08.837860 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:08.839022 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-41d2c092-a060-47fe-96eb-158d9ad3cb8c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1372 microversion: 2.20 time: 0.190600 May 17 22:14:08.839679 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 416/805] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:08 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:09.347454 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3ac466cf-9953-4fce-af76-b695d78aab58 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:09.348042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3ac466cf-9953-4fce-af76-b695d78aab58 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:09.355625 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3ac466cf-9953-4fce-af76-b695d78aab58 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:09.356070 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3ac466cf-9953-4fce-af76-b695d78aab58 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:09.356828 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3ac466cf-9953-4fce-af76-b695d78aab58 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:09.357260 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3ac466cf-9953-4fce-af76-b695d78aab58 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:09.486210 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3ac466cf-9953-4fce-af76-b695d78aab58 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:09.494184 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3ac466cf-9953-4fce-af76-b695d78aab58 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1674 microversion: 2.1 time: 0.150551 May 17 22:14:09.494743 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 390/806] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:09 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:09.857812 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:09.858418 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:09.865625 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:09.866068 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:09.866845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:09.867319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:09.897972 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:09.898427 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:09.898884 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lazy-loading 'fault' on Instance uuid 5c568a7b-6b45-45c4-b60a-3514d7c43e6e {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:14:09.939948 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:09.948417 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:09.949898 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:09.951029 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3b990d52-898d-4a85-9529-d385e90649a0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1372 microversion: 2.20 time: 0.097151 May 17 22:14:09.951605 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 417/807] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:09 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:10.511714 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-27bfdcf1-d9b9-445a-9d25-6eaf80de284a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:10.512258 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-27bfdcf1-d9b9-445a-9d25-6eaf80de284a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:10.518578 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-27bfdcf1-d9b9-445a-9d25-6eaf80de284a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:10.519020 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-27bfdcf1-d9b9-445a-9d25-6eaf80de284a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:10.519859 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-27bfdcf1-d9b9-445a-9d25-6eaf80de284a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:10.520294 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-27bfdcf1-d9b9-445a-9d25-6eaf80de284a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:10.663078 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-27bfdcf1-d9b9-445a-9d25-6eaf80de284a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:10.670443 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-27bfdcf1-d9b9-445a-9d25-6eaf80de284a tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1674 microversion: 2.1 time: 0.162719 May 17 22:14:10.671001 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 391/808] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:10 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:10.968616 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:10.969282 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:10.975838 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:10.976285 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:10.977053 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:10.977548 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:11.009263 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:11.009709 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:11.010150 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lazy-loading 'fault' on Instance uuid 5c568a7b-6b45-45c4-b60a-3514d7c43e6e {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:14:11.049870 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:11.058175 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:11.059703 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:11.060839 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-97dd2f34-251b-4f77-8361-ce33ee4293d1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 200 len: 1372 microversion: 2.20 time: 0.096249 May 17 22:14:11.061645 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 418/809] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:10 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:11.689488 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0684bcc4-9af3-499f-82fe-e0e9d7d4b496 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:11.690243 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0684bcc4-9af3-499f-82fe-e0e9d7d4b496 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:11.699634 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0684bcc4-9af3-499f-82fe-e0e9d7d4b496 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:11.700128 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0684bcc4-9af3-499f-82fe-e0e9d7d4b496 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:11.700912 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0684bcc4-9af3-499f-82fe-e0e9d7d4b496 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:11.701352 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0684bcc4-9af3-499f-82fe-e0e9d7d4b496 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:11.838782 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0684bcc4-9af3-499f-82fe-e0e9d7d4b496 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:11.847023 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0684bcc4-9af3-499f-82fe-e0e9d7d4b496 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1674 microversion: 2.1 time: 0.162042 May 17 22:14:11.847629 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 392/810] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:11 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:12.080043 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d7794f09-883a-4f7b-901e-fa1cdcff839f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:12.080656 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d7794f09-883a-4f7b-901e-fa1cdcff839f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:12.087029 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d7794f09-883a-4f7b-901e-fa1cdcff839f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:12.088059 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d7794f09-883a-4f7b-901e-fa1cdcff839f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:12.088263 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d7794f09-883a-4f7b-901e-fa1cdcff839f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:12.088701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d7794f09-883a-4f7b-901e-fa1cdcff839f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:12.104833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-d7794f09-883a-4f7b-901e-fa1cdcff839f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] HTTP exception thrown: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d7794f09-883a-4f7b-901e-fa1cdcff839f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Request method failure captured: May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e HTTP/1.1 May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0DBuUCDbUUBogi2Dmx9B174FuWcGKRf3wUJU9BKQh9667kNVTOc5RAippxlvprF2m97AlLO0tv0W9tFdb9_LMMXxMtlddDda75WXbt5zXMoyMrK28p8R1vEOz6-VOcgaSCsKOoK9kcESzPJTO8MxwXkcnNPoA3Mjkl_zHLlJukN8A May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Openstack-Nova-Api-Version: 2.20 May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 422158a05bcb44c8917cf1a6408cd7ad May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:14:12.106474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:14:12.108071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_422158a05bcb44c8917cf1a6408cd7ad", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:14:12.108071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:14:12.108071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 422158a05bcb44c8917cf1a6408cd7ad May 17 22:14:12.108071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:14:12.108071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeShelveTestJSON-1073204662-project May 17 22:14:12.108071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:14:12.108071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:14:12.108071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 532092f483874f05bc119211b9624492 May 17 22:14:12.108071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1073204662-project May 17 22:14:12.108071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:14:12.108071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:14:12.108071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '5c568a7b-6b45-45c4-b60a-3514d7c43e6e'} May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:14:12.113003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:14:12.114995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:12.116266 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d7794f09-883a-4f7b-901e-fa1cdcff839f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Returning 404 to user: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:14:12.116266 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d7794f09-883a-4f7b-901e-fa1cdcff839f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 404 len: 111 microversion: 2.20 time: 0.031839 May 17 22:14:12.116266 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 419/811] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:12 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 22:14:12.119218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-85778fa0-47f1-4e43-a23f-0d3657e5465d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '.version_select at 0x7f09f1f11a60>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:12.149623 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-547bd1f8-78b4-4d40-afe0-757bf12d8237 req-5fcd0c5f-6834-4d6b-929c-99c1750fede4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e6e64e-c18e-4856-9a95-0833c10482ee", "name": "network-vif-deleted", "tag": "de95285b-0a74-427f-90f8-1b48b78cd597"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:12.157547 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-547bd1f8-78b4-4d40-afe0-757bf12d8237 req-5fcd0c5f-6834-4d6b-929c-99c1750fede4 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:12.158307 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-547bd1f8-78b4-4d40-afe0-757bf12d8237 req-5fcd0c5f-6834-4d6b-929c-99c1750fede4 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:12.169678 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-547bd1f8-78b4-4d40-afe0-757bf12d8237 req-5fcd0c5f-6834-4d6b-929c-99c1750fede4 service nova] Creating event network-vif-deleted:de95285b-0a74-427f-90f8-1b48b78cd597 for instance 65e6e64e-c18e-4856-9a95-0833c10482ee on hv-cinder-83998 May 17 22:14:12.175924 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-547bd1f8-78b4-4d40-afe0-757bf12d8237 req-5fcd0c5f-6834-4d6b-929c-99c1750fede4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029678 May 17 22:14:12.175924 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 420/812] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:14:12.225753 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-85778fa0-47f1-4e43-a23f-0d3657e5465d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143976754" status: 204 len: 0 microversion: 2.20 time: 0.111547 May 17 22:14:12.230102 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 393/813] 10.222.0.24 () {60 vars in 1261 bytes} [Tue May 17 22:14:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143976754 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 22:14:12.866171 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7d32ffdb-801b-4415-8d4d-d414a370c3e2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:12.866868 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7d32ffdb-801b-4415-8d4d-d414a370c3e2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:12.874020 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d32ffdb-801b-4415-8d4d-d414a370c3e2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:12.874020 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d32ffdb-801b-4415-8d4d-d414a370c3e2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:12.874493 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d32ffdb-801b-4415-8d4d-d414a370c3e2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:12.875142 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d32ffdb-801b-4415-8d4d-d414a370c3e2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:12.915413 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d32ffdb-801b-4415-8d4d-d414a370c3e2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:12.915853 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7d32ffdb-801b-4415-8d4d-d414a370c3e2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:12.916300 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-7d32ffdb-801b-4415-8d4d-d414a370c3e2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lazy-loading 'fault' on Instance uuid 65e6e64e-c18e-4856-9a95-0833c10482ee {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:14:12.992966 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7d32ffdb-801b-4415-8d4d-d414a370c3e2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:13.002023 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7d32ffdb-801b-4415-8d4d-d414a370c3e2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 200 len: 1328 microversion: 2.1 time: 0.140957 May 17 22:14:13.002713 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 421/814] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:12 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 1328 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:13.106126 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f3a55593-bfef-41e6-9bcb-8f7eb78523b5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Action: 'create', calling method: .version_select at 0x7f09f1f553a0>, body: {"keypair": {"name": "tempest-keypair-754303135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmUnoz0+TejoNYpIjjDTYaa4YTy1x+qbPBPHdUiWEtAV6d2UwCxlXjRNC79kBnS0PS4TOhIa3z7hOfFYlg2j27k3L20woQ2IAo2lNY1Nof33zMFKSKATqu+xM7qkH+mnA=="}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:13.122810 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-f3a55593-bfef-41e6-9bcb-8f7eb78523b5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Getting quotas for project 422158a05bcb44c8917cf1a6408cd7ad. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:14:13.126712 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-f3a55593-bfef-41e6-9bcb-8f7eb78523b5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Getting quotas for user 532092f483874f05bc119211b9624492 and project 422158a05bcb44c8917cf1a6408cd7ad. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:14:13.235694 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f3a55593-bfef-41e6-9bcb-8f7eb78523b5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.133840 May 17 22:14:13.236289 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 394/815] 10.222.0.24 () {62 vars in 1199 bytes} [Tue May 17 22:14:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 17 22:14:14.129968 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-18c33623-6ee7-4cfa-9b70-9328858baabb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:14.130661 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-18c33623-6ee7-4cfa-9b70-9328858baabb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:14.137714 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-18c33623-6ee7-4cfa-9b70-9328858baabb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:14.138164 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-18c33623-6ee7-4cfa-9b70-9328858baabb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:14.139031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-18c33623-6ee7-4cfa-9b70-9328858baabb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:14.139499 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-18c33623-6ee7-4cfa-9b70-9328858baabb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:14.157541 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-18c33623-6ee7-4cfa-9b70-9328858baabb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] HTTP exception thrown: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-18c33623-6ee7-4cfa-9b70-9328858baabb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Request method failure captured: May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee HTTP/1.1 May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0JcJQZNanKAInsUwM8DUyQL8POChFnPtKN-V6H8MHRq_7JmttrczJ_x53edlliGpPmXKvyfoEAYdcrruIgm53o2KEoALfKJXGQlqKa4LgmnQPasgtfNvnffh-1IV5aKcHaIftIeBmcPqu8z4VYqwW6HH8lg58nuSCNN4tyAUDrmyI May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: fe9b23322633464f975b94a2144fa300 May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeTestJSON-1253707150 May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:14:14.160798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:14:14.162763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fe9b23322633464f975b94a2144fa300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_fe9b23322633464f975b94a2144fa300", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/fe9b23322633464f975b94a2144fa300"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fe9b23322633464f975b94a2144fa300"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:14:14.162763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeTestJSON-1253707150 May 17 22:14:14.162763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: fe9b23322633464f975b94a2144fa300 May 17 22:14:14.162763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1253707150 May 17 22:14:14.162763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeTestJSON-1253707150-project May 17 22:14:14.162763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:14:14.162763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:14:14.162763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 626cf3ce22fd4d019022b52e21916a2f May 17 22:14:14.162763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeTestJSON-1253707150-project May 17 22:14:14.162763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:14:14.162763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:14:14.162763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '65e6e64e-c18e-4856-9a95-0833c10482ee'} May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:14:14.164268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:14:14.165720 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:14.166988 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-18c33623-6ee7-4cfa-9b70-9328858baabb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Returning 404 to user: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:14:14.166988 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-18c33623-6ee7-4cfa-9b70-9328858baabb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 404 len: 111 microversion: 2.1 time: 0.143173 May 17 22:14:14.166988 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 422/816] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:14 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:14:14.173408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9c9d6990-5c33-434b-8e03-e714600ec79f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '.version_select at 0x7f09f1f55040>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:14.229602 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9c9d6990-5c33-434b-8e03-e714600ec79f tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617106322" status: 202 len: 0 microversion: 2.1 time: 0.059996 May 17 22:14:14.230258 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 395/817] 10.222.0.24 () {58 vars in 1220 bytes} [Tue May 17 22:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617106322 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:14:15.161985 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ba932f22-2521-4360-82d3-e6155fa4e50b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Action: 'create', calling method: .version_select at 0x7f09f72a54c0>, body: {"keypair": {"name": "tempest-keypair-791898968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJa5OvYBokUvdVxswR4uZAmGXx0NktWpprAp6zawkHoHvZDq8B85YHEXJcf6qvziPzZeD++xGIG5OXGpHJiaDkeYlgkg4gnHEwsaRXH5Kcvn6k6K48cdlqv40iGkUGCA9g=="}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:15.177016 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-ba932f22-2521-4360-82d3-e6155fa4e50b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Getting quotas for project fe9b23322633464f975b94a2144fa300. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:14:15.180983 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-ba932f22-2521-4360-82d3-e6155fa4e50b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Getting quotas for user 626cf3ce22fd4d019022b52e21916a2f and project fe9b23322633464f975b94a2144fa300. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:14:15.272856 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ba932f22-2521-4360-82d3-e6155fa4e50b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.114812 May 17 22:14:15.273453 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 423/818] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 17 22:14:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:15.766517 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-176979028", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a32e06d-55b9-408a-a0d4-94ee7082349b"}], "security_groups": [{"name": "tempest-securitygroup--374085480"}], "key_name": "tempest-keypair-754303135", "user_data": "}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:15.879649 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] validate_networks() for [('9a32e06d-55b9-408a-a0d4-94ee7082349b', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:14:16.386810 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:14:16.387318 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:14:16.387787 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:14:16.388187 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:14:16.388589 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:14:16.397962 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:16.398404 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:16.399229 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:16.399658 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:16.415777 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Getting quotas for project 422158a05bcb44c8917cf1a6408cd7ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:14:16.419545 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Getting quotas for user 532092f483874f05bc119211b9624492 and project 422158a05bcb44c8917cf1a6408cd7ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:14:16.431872 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:14:16.434203 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:14:16.603663 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-34e92cfe-dd32-48ae-9ebd-4682cdb4d9a2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.828804 May 17 22:14:16.603663 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 396/819] 10.222.0.24 () {62 vars in 1187 bytes} [Tue May 17 22:14:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 17 22:14:16.611321 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0f457402-1b25-4742-8f4a-7da790665440 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:16.612088 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0f457402-1b25-4742-8f4a-7da790665440 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:16.691099 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0f457402-1b25-4742-8f4a-7da790665440 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:16.704126 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0f457402-1b25-4742-8f4a-7da790665440 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:16.705903 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0f457402-1b25-4742-8f4a-7da790665440 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:16.707040 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0f457402-1b25-4742-8f4a-7da790665440 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1280 microversion: 2.20 time: 0.102365 May 17 22:14:16.708610 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 424/820] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:16 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:17.727322 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a3ae0d94-b49d-43ef-830e-193b26b54d35 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:17.727933 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a3ae0d94-b49d-43ef-830e-193b26b54d35 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:17.738100 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3ae0d94-b49d-43ef-830e-193b26b54d35 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:17.738100 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3ae0d94-b49d-43ef-830e-193b26b54d35 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:17.738100 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3ae0d94-b49d-43ef-830e-193b26b54d35 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:17.738100 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3ae0d94-b49d-43ef-830e-193b26b54d35 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:17.784120 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-422536954", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4c55ac9-e586-497b-b788-2ee3d019ca2d"}], "security_groups": [{"name": "tempest-securitygroup--744124600"}], "key_name": "tempest-keypair-791898968", "user_data": "}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:17.808417 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a3ae0d94-b49d-43ef-830e-193b26b54d35 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:17.816702 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a3ae0d94-b49d-43ef-830e-193b26b54d35 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:17.818204 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a3ae0d94-b49d-43ef-830e-193b26b54d35 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:17.819326 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a3ae0d94-b49d-43ef-830e-193b26b54d35 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1284 microversion: 2.20 time: 0.097113 May 17 22:14:17.819886 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 397/821] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:17 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:14:17.887435 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] validate_networks() for [('b4c55ac9-e586-497b-b788-2ee3d019ca2d', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:14:18.283070 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:14:18.283522 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:14:18.283997 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:14:18.284443 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:14:18.284858 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:14:18.293717 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:18.295640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:18.295640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:18.295640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:18.311933 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Getting quotas for project fe9b23322633464f975b94a2144fa300. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:14:18.315889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Getting quotas for user 626cf3ce22fd4d019022b52e21916a2f and project fe9b23322633464f975b94a2144fa300. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:14:18.327360 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:14:18.329642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:14:18.432496 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-39d5929f-931e-4447-b69b-36f8a5457c26 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.652606 May 17 22:14:18.433131 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 425/822] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:14:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 22:14:18.447979 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b3364de4-c60c-4fc2-a60f-7bec67ecb1b4 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:18.447979 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b3364de4-c60c-4fc2-a60f-7bec67ecb1b4 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:18.496999 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b3364de4-c60c-4fc2-a60f-7bec67ecb1b4 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:18.503594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b3364de4-c60c-4fc2-a60f-7bec67ecb1b4 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1236 microversion: 2.1 time: 0.064051 May 17 22:14:18.504771 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 398/823] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:18 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1236 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:18.837335 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-53ff12f7-15b3-4eaa-8005-aac9117a6cd2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:18.837948 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-53ff12f7-15b3-4eaa-8005-aac9117a6cd2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:18.844991 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53ff12f7-15b3-4eaa-8005-aac9117a6cd2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:18.845907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53ff12f7-15b3-4eaa-8005-aac9117a6cd2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:18.846715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53ff12f7-15b3-4eaa-8005-aac9117a6cd2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:18.848279 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53ff12f7-15b3-4eaa-8005-aac9117a6cd2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:18.948728 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-53ff12f7-15b3-4eaa-8005-aac9117a6cd2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:18.989791 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-53ff12f7-15b3-4eaa-8005-aac9117a6cd2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:18.992711 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-53ff12f7-15b3-4eaa-8005-aac9117a6cd2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:18.994058 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-53ff12f7-15b3-4eaa-8005-aac9117a6cd2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1340 microversion: 2.20 time: 0.161278 May 17 22:14:18.999789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 426/824] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:18 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1340 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:19.521542 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-035622ec-9747-46fa-bc99-8bb04783a0a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:19.522102 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-035622ec-9747-46fa-bc99-8bb04783a0a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:19.529925 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-035622ec-9747-46fa-bc99-8bb04783a0a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:19.530378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-035622ec-9747-46fa-bc99-8bb04783a0a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:19.531183 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-035622ec-9747-46fa-bc99-8bb04783a0a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:19.531619 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-035622ec-9747-46fa-bc99-8bb04783a0a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:19.637836 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-035622ec-9747-46fa-bc99-8bb04783a0a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:19.646784 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-035622ec-9747-46fa-bc99-8bb04783a0a2 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1240 microversion: 2.1 time: 0.129733 May 17 22:14:19.647748 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 399/825] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:19 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1240 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:20.012012 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-812290c1-cea5-49d3-9c86-dcf283f7b212 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:20.012615 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-812290c1-cea5-49d3-9c86-dcf283f7b212 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:20.019372 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-812290c1-cea5-49d3-9c86-dcf283f7b212 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:20.019846 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-812290c1-cea5-49d3-9c86-dcf283f7b212 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:20.021786 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-812290c1-cea5-49d3-9c86-dcf283f7b212 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:20.022274 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-812290c1-cea5-49d3-9c86-dcf283f7b212 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:20.226174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-812290c1-cea5-49d3-9c86-dcf283f7b212 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:20.234447 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-812290c1-cea5-49d3-9c86-dcf283f7b212 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:20.235977 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-812290c1-cea5-49d3-9c86-dcf283f7b212 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:20.237112 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-812290c1-cea5-49d3-9c86-dcf283f7b212 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1405 microversion: 2.20 time: 0.229465 May 17 22:14:20.237666 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 427/826] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:20 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:20.666606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7809ebc3-d825-47e7-be02-e03dff0f8362 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:20.667239 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7809ebc3-d825-47e7-be02-e03dff0f8362 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:20.675098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7809ebc3-d825-47e7-be02-e03dff0f8362 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:20.675607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7809ebc3-d825-47e7-be02-e03dff0f8362 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:20.676951 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7809ebc3-d825-47e7-be02-e03dff0f8362 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:20.677391 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7809ebc3-d825-47e7-be02-e03dff0f8362 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:20.809470 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7809ebc3-d825-47e7-be02-e03dff0f8362 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:20.818670 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7809ebc3-d825-47e7-be02-e03dff0f8362 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1296 microversion: 2.1 time: 0.155843 May 17 22:14:20.819291 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 400/827] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:20 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1296 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:21.256578 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ab5d274c-24d8-41e0-9c5a-7cfcbe787816 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:21.257389 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ab5d274c-24d8-41e0-9c5a-7cfcbe787816 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:21.263624 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ab5d274c-24d8-41e0-9c5a-7cfcbe787816 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:21.264070 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ab5d274c-24d8-41e0-9c5a-7cfcbe787816 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:21.264859 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ab5d274c-24d8-41e0-9c5a-7cfcbe787816 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:21.265297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ab5d274c-24d8-41e0-9c5a-7cfcbe787816 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:21.652257 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ab5d274c-24d8-41e0-9c5a-7cfcbe787816 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:21.660947 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ab5d274c-24d8-41e0-9c5a-7cfcbe787816 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:21.662798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ab5d274c-24d8-41e0-9c5a-7cfcbe787816 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:21.664030 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ab5d274c-24d8-41e0-9c5a-7cfcbe787816 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1405 microversion: 2.20 time: 0.412813 May 17 22:14:21.664584 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 428/828] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:21 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:21.690092 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-5be361f7-11e6-441c-9028-3bc83dd0c194 req-08b619bb-6e59-4962-9cff-f242f880958f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c", "tag": "01f9ff90-5b71-4555-bb92-f5d36e9518eb"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:21.721852 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-5be361f7-11e6-441c-9028-3bc83dd0c194 req-08b619bb-6e59-4962-9cff-f242f880958f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:21.722301 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-5be361f7-11e6-441c-9028-3bc83dd0c194 req-08b619bb-6e59-4962-9cff-f242f880958f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:21.740536 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-5be361f7-11e6-441c-9028-3bc83dd0c194 req-08b619bb-6e59-4962-9cff-f242f880958f service nova] Creating event network-changed:01f9ff90-5b71-4555-bb92-f5d36e9518eb for instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c on hv-cinder-83998 May 17 22:14:21.746868 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-5be361f7-11e6-441c-9028-3bc83dd0c194 req-08b619bb-6e59-4962-9cff-f242f880958f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150956 May 17 22:14:21.747509 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 401/829] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:21.837976 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ed0c5f64-2388-4254-8e5b-7f5e65b7f217 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:21.838919 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ed0c5f64-2388-4254-8e5b-7f5e65b7f217 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:21.845879 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ed0c5f64-2388-4254-8e5b-7f5e65b7f217 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:21.846255 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ed0c5f64-2388-4254-8e5b-7f5e65b7f217 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:21.847045 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ed0c5f64-2388-4254-8e5b-7f5e65b7f217 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:21.847529 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ed0c5f64-2388-4254-8e5b-7f5e65b7f217 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:21.968662 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ed0c5f64-2388-4254-8e5b-7f5e65b7f217 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:21.981214 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ed0c5f64-2388-4254-8e5b-7f5e65b7f217 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1294 microversion: 2.1 time: 0.148588 May 17 22:14:21.982868 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 429/830] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:21 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1294 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:22.694369 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-63112093-a636-4a87-b8c3-e3ce5a84a3bf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:22.695220 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-63112093-a636-4a87-b8c3-e3ce5a84a3bf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:22.703510 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-63112093-a636-4a87-b8c3-e3ce5a84a3bf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:22.709823 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-63112093-a636-4a87-b8c3-e3ce5a84a3bf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:22.709823 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-63112093-a636-4a87-b8c3-e3ce5a84a3bf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:22.709823 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-63112093-a636-4a87-b8c3-e3ce5a84a3bf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:22.943219 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-63112093-a636-4a87-b8c3-e3ce5a84a3bf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:22.962153 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-63112093-a636-4a87-b8c3-e3ce5a84a3bf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:22.963981 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-63112093-a636-4a87-b8c3-e3ce5a84a3bf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:22.965109 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-63112093-a636-4a87-b8c3-e3ce5a84a3bf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1405 microversion: 2.20 time: 0.278869 May 17 22:14:22.967172 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 402/831] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:22 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1405 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:23.003436 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-67bffdb1-8994-44a3-9684-694de30df1ce tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:23.008085 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-67bffdb1-8994-44a3-9684-694de30df1ce tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:23.011274 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-67bffdb1-8994-44a3-9684-694de30df1ce tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:23.011790 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-67bffdb1-8994-44a3-9684-694de30df1ce tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:23.012630 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-67bffdb1-8994-44a3-9684-694de30df1ce tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:23.013189 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-67bffdb1-8994-44a3-9684-694de30df1ce tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:23.174580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-67bffdb1-8994-44a3-9684-694de30df1ce tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:23.185262 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-67bffdb1-8994-44a3-9684-694de30df1ce tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1361 microversion: 2.1 time: 0.187898 May 17 22:14:23.185805 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 430/832] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:22 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:23.992023 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d35c3832-eab8-4222-9b60-062016ad8827 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:23.993372 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d35c3832-eab8-4222-9b60-062016ad8827 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:24.001277 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d35c3832-eab8-4222-9b60-062016ad8827 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:24.002349 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d35c3832-eab8-4222-9b60-062016ad8827 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:24.003422 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d35c3832-eab8-4222-9b60-062016ad8827 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:24.004736 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d35c3832-eab8-4222-9b60-062016ad8827 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:24.072334 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-56c3a874-5a0c-4b68-90fc-2af0fbbca12b req-6dfe0496-3f39-483c-9a83-e17148822d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4d36e2-0f10-4434-ad5d-cc27b81e923e", "tag": "2c450f46-d2e6-4987-8fa7-2c91fde11f5b"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:24.080989 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-56c3a874-5a0c-4b68-90fc-2af0fbbca12b req-6dfe0496-3f39-483c-9a83-e17148822d24 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:24.081438 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-56c3a874-5a0c-4b68-90fc-2af0fbbca12b req-6dfe0496-3f39-483c-9a83-e17148822d24 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:24.092604 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-56c3a874-5a0c-4b68-90fc-2af0fbbca12b req-6dfe0496-3f39-483c-9a83-e17148822d24 service nova] Creating event network-changed:2c450f46-d2e6-4987-8fa7-2c91fde11f5b for instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e on hv-cinder-83998 May 17 22:14:24.098570 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-56c3a874-5a0c-4b68-90fc-2af0fbbca12b req-6dfe0496-3f39-483c-9a83-e17148822d24 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029741 May 17 22:14:24.110924 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 431/833] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:24.204152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7606812b-ec8e-4d6e-b48b-f80cf2b4c2d6 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:24.205001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7606812b-ec8e-4d6e-b48b-f80cf2b4c2d6 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:24.211673 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7606812b-ec8e-4d6e-b48b-f80cf2b4c2d6 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:24.212344 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7606812b-ec8e-4d6e-b48b-f80cf2b4c2d6 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:24.213492 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7606812b-ec8e-4d6e-b48b-f80cf2b4c2d6 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:24.213994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7606812b-ec8e-4d6e-b48b-f80cf2b4c2d6 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:24.346695 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d35c3832-eab8-4222-9b60-062016ad8827 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:24.357429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d35c3832-eab8-4222-9b60-062016ad8827 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:24.359121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d35c3832-eab8-4222-9b60-062016ad8827 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:24.360373 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d35c3832-eab8-4222-9b60-062016ad8827 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1405 microversion: 2.20 time: 0.376494 May 17 22:14:24.361044 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 403/834] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:23 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1405 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:24.553404 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7606812b-ec8e-4d6e-b48b-f80cf2b4c2d6 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:24.560667 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7606812b-ec8e-4d6e-b48b-f80cf2b4c2d6 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1361 microversion: 2.1 time: 0.360711 May 17 22:14:24.561510 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 432/835] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:24 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1361 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:14:25.109571 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-57652e79-b6c5-4d06-a79d-38333e6abed5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:25.110099 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-57652e79-b6c5-4d06-a79d-38333e6abed5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:25.116513 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-57652e79-b6c5-4d06-a79d-38333e6abed5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:25.116980 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-57652e79-b6c5-4d06-a79d-38333e6abed5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:25.117740 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-57652e79-b6c5-4d06-a79d-38333e6abed5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:25.118171 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-57652e79-b6c5-4d06-a79d-38333e6abed5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:25.211569 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-57652e79-b6c5-4d06-a79d-38333e6abed5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lazy-loading 'services' on Instance uuid da3e521e-c843-4727-8c31-00c86e4e6aa0 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:14:25.379967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ebd81d32-f11d-4793-9d79-b38cf06082ef tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:25.381380 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ebd81d32-f11d-4793-9d79-b38cf06082ef tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:25.388058 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ebd81d32-f11d-4793-9d79-b38cf06082ef tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:25.388514 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ebd81d32-f11d-4793-9d79-b38cf06082ef tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:25.389302 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ebd81d32-f11d-4793-9d79-b38cf06082ef tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:25.389736 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ebd81d32-f11d-4793-9d79-b38cf06082ef tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:25.461119 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-57652e79-b6c5-4d06-a79d-38333e6abed5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "DELETE /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments/b1a5b4fb-9987-43f9-a237-264fec6faf4f" status: 202 len: 0 microversion: 2.1 time: 0.355114 May 17 22:14:25.462308 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 404/836] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 17 22:14:25 2022] DELETE /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments/b1a5b4fb-9987-43f9-a237-264fec6faf4f => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:14:25.471143 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-da4b1ad1-c004-45e3-8af5-87217fc40f02 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:25.472633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-da4b1ad1-c004-45e3-8af5-87217fc40f02 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:25.480089 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-da4b1ad1-c004-45e3-8af5-87217fc40f02 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:25.480929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-da4b1ad1-c004-45e3-8af5-87217fc40f02 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:25.481854 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-da4b1ad1-c004-45e3-8af5-87217fc40f02 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:25.482385 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-da4b1ad1-c004-45e3-8af5-87217fc40f02 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:25.517631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-da4b1ad1-c004-45e3-8af5-87217fc40f02 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050811 May 17 22:14:25.518819 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 405/837] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:25 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:25.561082 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ebd81d32-f11d-4793-9d79-b38cf06082ef tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:25.570255 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ebd81d32-f11d-4793-9d79-b38cf06082ef tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:25.578826 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ebd81d32-f11d-4793-9d79-b38cf06082ef tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:25.578826 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ebd81d32-f11d-4793-9d79-b38cf06082ef tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1405 microversion: 2.20 time: 0.197330 May 17 22:14:25.578826 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 433/838] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:25 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:14:25.591306 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e9517b29-d540-4a3b-ad50-f8b220046044 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:25.592171 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e9517b29-d540-4a3b-ad50-f8b220046044 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:25.600035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e9517b29-d540-4a3b-ad50-f8b220046044 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:25.600482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e9517b29-d540-4a3b-ad50-f8b220046044 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:25.601431 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e9517b29-d540-4a3b-ad50-f8b220046044 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:25.601873 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e9517b29-d540-4a3b-ad50-f8b220046044 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:25.740006 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e9517b29-d540-4a3b-ad50-f8b220046044 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:25.754673 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e9517b29-d540-4a3b-ad50-f8b220046044 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1361 microversion: 2.1 time: 0.173201 May 17 22:14:25.754673 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 406/839] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:25 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:26.530110 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f56d03e6-0777-40dd-8e5e-a2117b2f5a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:26.531322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f56d03e6-0777-40dd-8e5e-a2117b2f5a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:26.539247 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f56d03e6-0777-40dd-8e5e-a2117b2f5a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:26.539698 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f56d03e6-0777-40dd-8e5e-a2117b2f5a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:26.540485 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f56d03e6-0777-40dd-8e5e-a2117b2f5a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:26.541058 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f56d03e6-0777-40dd-8e5e-a2117b2f5a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:26.576718 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f56d03e6-0777-40dd-8e5e-a2117b2f5a88 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050594 May 17 22:14:26.577880 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 434/840] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:26 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:26.595257 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6c26b8ba-ed63-4ef5-9780-2f1298074447 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:26.596466 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6c26b8ba-ed63-4ef5-9780-2f1298074447 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:26.611989 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6c26b8ba-ed63-4ef5-9780-2f1298074447 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:26.613289 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6c26b8ba-ed63-4ef5-9780-2f1298074447 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:26.613289 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6c26b8ba-ed63-4ef5-9780-2f1298074447 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:26.613725 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6c26b8ba-ed63-4ef5-9780-2f1298074447 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:26.770066 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e69544ce-b910-4240-b895-eb737ff37f78 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:26.773470 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e69544ce-b910-4240-b895-eb737ff37f78 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:26.778008 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e69544ce-b910-4240-b895-eb737ff37f78 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:26.778661 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e69544ce-b910-4240-b895-eb737ff37f78 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:26.779630 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e69544ce-b910-4240-b895-eb737ff37f78 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:26.780440 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e69544ce-b910-4240-b895-eb737ff37f78 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:26.798741 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6c26b8ba-ed63-4ef5-9780-2f1298074447 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:26.808808 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6c26b8ba-ed63-4ef5-9780-2f1298074447 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:26.810319 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6c26b8ba-ed63-4ef5-9780-2f1298074447 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:26.811996 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6c26b8ba-ed63-4ef5-9780-2f1298074447 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1405 microversion: 2.20 time: 0.220730 May 17 22:14:26.812569 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 407/841] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:26 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:26.989694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e69544ce-b910-4240-b895-eb737ff37f78 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:26.998346 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e69544ce-b910-4240-b895-eb737ff37f78 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1361 microversion: 2.1 time: 0.233042 May 17 22:14:26.999786 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 435/842] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:26 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:14:27.589147 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-eae21d9e-ce8a-458d-b170-9570db9a23df tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:27.590120 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-eae21d9e-ce8a-458d-b170-9570db9a23df tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:27.596895 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eae21d9e-ce8a-458d-b170-9570db9a23df tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:27.598155 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eae21d9e-ce8a-458d-b170-9570db9a23df tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:27.598836 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eae21d9e-ce8a-458d-b170-9570db9a23df tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:27.599322 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-eae21d9e-ce8a-458d-b170-9570db9a23df tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:27.629635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-eae21d9e-ce8a-458d-b170-9570db9a23df tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043845 May 17 22:14:27.634910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 408/843] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:27 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 22:14:27.712598 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4fceaea3-1974-41e6-9ce7-adfb587ad8dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:27.713224 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4fceaea3-1974-41e6-9ce7-adfb587ad8dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:27.719410 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4fceaea3-1974-41e6-9ce7-adfb587ad8dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:27.719884 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4fceaea3-1974-41e6-9ce7-adfb587ad8dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:27.720642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4fceaea3-1974-41e6-9ce7-adfb587ad8dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:27.721073 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4fceaea3-1974-41e6-9ce7-adfb587ad8dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:27.747350 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4fceaea3-1974-41e6-9ce7-adfb587ad8dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:14:27.830822 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-10077129-3122-49d5-bcdb-714c343b5cba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:27.831551 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-10077129-3122-49d5-bcdb-714c343b5cba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:27.839429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10077129-3122-49d5-bcdb-714c343b5cba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:27.839917 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10077129-3122-49d5-bcdb-714c343b5cba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:27.840658 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10077129-3122-49d5-bcdb-714c343b5cba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:27.841085 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10077129-3122-49d5-bcdb-714c343b5cba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:27.990462 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-10077129-3122-49d5-bcdb-714c343b5cba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:28.000800 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-10077129-3122-49d5-bcdb-714c343b5cba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:28.002296 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-10077129-3122-49d5-bcdb-714c343b5cba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:28.003596 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-10077129-3122-49d5-bcdb-714c343b5cba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1405 microversion: 2.20 time: 0.176857 May 17 22:14:28.004951 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 409/844] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:27 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:28.017958 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-736624ea-b9f9-402e-a210-7fe500282d3d req-b9e59eed-19f0-4991-8f1a-47913a60b0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c", "name": "network-vif-plugged", "status": "completed", "tag": "01f9ff90-5b71-4555-bb92-f5d36e9518eb"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:28.028907 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-736624ea-b9f9-402e-a210-7fe500282d3d req-b9e59eed-19f0-4991-8f1a-47913a60b0f9 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:28.029348 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-736624ea-b9f9-402e-a210-7fe500282d3d req-b9e59eed-19f0-4991-8f1a-47913a60b0f9 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:28.044216 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-736624ea-b9f9-402e-a210-7fe500282d3d req-b9e59eed-19f0-4991-8f1a-47913a60b0f9 service nova] Creating event network-vif-plugged:01f9ff90-5b71-4555-bb92-f5d36e9518eb for instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c on hv-cinder-83998 May 17 22:14:28.049629 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-736624ea-b9f9-402e-a210-7fe500282d3d req-b9e59eed-19f0-4991-8f1a-47913a60b0f9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039711 May 17 22:14:28.050531 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 410/845] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:14:28.057554 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0ad51aee-4658-4233-a7e3-e020b3cc42a5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:28.058505 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0ad51aee-4658-4233-a7e3-e020b3cc42a5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:28.068624 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ad51aee-4658-4233-a7e3-e020b3cc42a5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:28.069368 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ad51aee-4658-4233-a7e3-e020b3cc42a5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:28.070350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ad51aee-4658-4233-a7e3-e020b3cc42a5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:28.070932 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0ad51aee-4658-4233-a7e3-e020b3cc42a5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:28.186056 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4fceaea3-1974-41e6-9ce7-adfb587ad8dd tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "DELETE /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 204 len: 0 microversion: 2.1 time: 0.476864 May 17 22:14:28.190018 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 436/846] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:14:27 2022] DELETE /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:14:28.204951 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dc7c0f7e-01f4-4a55-8083-411d73633bdb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:28.209507 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dc7c0f7e-01f4-4a55-8083-411d73633bdb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:28.231601 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc7c0f7e-01f4-4a55-8083-411d73633bdb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:28.237688 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc7c0f7e-01f4-4a55-8083-411d73633bdb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:28.242786 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc7c0f7e-01f4-4a55-8083-411d73633bdb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:28.243489 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dc7c0f7e-01f4-4a55-8083-411d73633bdb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:28.357629 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0ad51aee-4658-4233-a7e3-e020b3cc42a5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:28.368788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0ad51aee-4658-4233-a7e3-e020b3cc42a5 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1361 microversion: 2.1 time: 0.315281 May 17 22:14:28.369936 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 411/847] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:28 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1361 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:28.428861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-dc7c0f7e-01f4-4a55-8083-411d73633bdb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:28.436683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dc7c0f7e-01f4-4a55-8083-411d73633bdb tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1691 microversion: 2.1 time: 0.244953 May 17 22:14:28.437446 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 437/848] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:28 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1691 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:29.026590 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-58b59b30-4013-4663-b2ba-3a5f6a86d5c6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:29.027998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-58b59b30-4013-4663-b2ba-3a5f6a86d5c6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:29.035845 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-58b59b30-4013-4663-b2ba-3a5f6a86d5c6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:29.037144 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-58b59b30-4013-4663-b2ba-3a5f6a86d5c6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:29.038526 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-58b59b30-4013-4663-b2ba-3a5f6a86d5c6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:29.039383 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-58b59b30-4013-4663-b2ba-3a5f6a86d5c6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:29.195964 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-58b59b30-4013-4663-b2ba-3a5f6a86d5c6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:29.209068 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-58b59b30-4013-4663-b2ba-3a5f6a86d5c6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:29.210862 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-58b59b30-4013-4663-b2ba-3a5f6a86d5c6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:29.212229 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-58b59b30-4013-4663-b2ba-3a5f6a86d5c6 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1405 microversion: 2.20 time: 0.194220 May 17 22:14:29.212795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 412/849] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:29 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:29.392167 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-51fc0b19-d4da-4c19-b524-fea1a5a38d4b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:29.392787 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-51fc0b19-d4da-4c19-b524-fea1a5a38d4b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:29.400514 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51fc0b19-d4da-4c19-b524-fea1a5a38d4b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:29.401100 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51fc0b19-d4da-4c19-b524-fea1a5a38d4b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:29.401932 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51fc0b19-d4da-4c19-b524-fea1a5a38d4b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:29.402419 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-51fc0b19-d4da-4c19-b524-fea1a5a38d4b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:29.454261 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4c76a43e-8e06-40bb-a9a1-dad68f3fda7c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:29.455097 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4c76a43e-8e06-40bb-a9a1-dad68f3fda7c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:29.462191 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c76a43e-8e06-40bb-a9a1-dad68f3fda7c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:29.462638 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c76a43e-8e06-40bb-a9a1-dad68f3fda7c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:29.463803 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c76a43e-8e06-40bb-a9a1-dad68f3fda7c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:29.464441 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4c76a43e-8e06-40bb-a9a1-dad68f3fda7c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:29.649966 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-51fc0b19-d4da-4c19-b524-fea1a5a38d4b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:29.661451 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-51fc0b19-d4da-4c19-b524-fea1a5a38d4b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1361 microversion: 2.1 time: 0.272155 May 17 22:14:29.671211 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 438/850] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:29 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:29.676944 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4c76a43e-8e06-40bb-a9a1-dad68f3fda7c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:29.698659 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4c76a43e-8e06-40bb-a9a1-dad68f3fda7c tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1691 microversion: 2.1 time: 0.248510 May 17 22:14:29.700077 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 413/851] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:29 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1691 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:30.079713 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-ebbf4c27-fd1a-4d42-821c-d5ae9d13b990 req-cafbda7a-82b2-4cf0-848a-53fe1a92abf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4d36e2-0f10-4434-ad5d-cc27b81e923e", "name": "network-vif-plugged", "status": "completed", "tag": "2c450f46-d2e6-4987-8fa7-2c91fde11f5b"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:30.088845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-ebbf4c27-fd1a-4d42-821c-d5ae9d13b990 req-cafbda7a-82b2-4cf0-848a-53fe1a92abf1 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:30.089292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-ebbf4c27-fd1a-4d42-821c-d5ae9d13b990 req-cafbda7a-82b2-4cf0-848a-53fe1a92abf1 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:30.103403 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-ebbf4c27-fd1a-4d42-821c-d5ae9d13b990 req-cafbda7a-82b2-4cf0-848a-53fe1a92abf1 service nova] Creating event network-vif-plugged:2c450f46-d2e6-4987-8fa7-2c91fde11f5b for instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e on hv-cinder-83998 May 17 22:14:30.109385 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-ebbf4c27-fd1a-4d42-821c-d5ae9d13b990 req-cafbda7a-82b2-4cf0-848a-53fe1a92abf1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034009 May 17 22:14:30.110966 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 439/852] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:30.231852 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-99c81979-f552-46c7-9e67-e9f98f44c837 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:30.232544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-99c81979-f552-46c7-9e67-e9f98f44c837 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:30.243555 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-99c81979-f552-46c7-9e67-e9f98f44c837 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:30.244818 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-99c81979-f552-46c7-9e67-e9f98f44c837 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:30.247785 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-99c81979-f552-46c7-9e67-e9f98f44c837 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:30.248318 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-99c81979-f552-46c7-9e67-e9f98f44c837 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:30.488678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-99c81979-f552-46c7-9e67-e9f98f44c837 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:30.504967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-99c81979-f552-46c7-9e67-e9f98f44c837 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:30.506476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-99c81979-f552-46c7-9e67-e9f98f44c837 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:30.507631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-99c81979-f552-46c7-9e67-e9f98f44c837 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1405 microversion: 2.20 time: 0.280221 May 17 22:14:30.508200 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 414/853] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:30 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1405 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:30.680588 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6d088284-0dea-45dc-a8da-4064820d17b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:30.681415 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6d088284-0dea-45dc-a8da-4064820d17b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:30.688526 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d088284-0dea-45dc-a8da-4064820d17b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:30.689420 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d088284-0dea-45dc-a8da-4064820d17b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:30.690139 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d088284-0dea-45dc-a8da-4064820d17b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:30.690789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6d088284-0dea-45dc-a8da-4064820d17b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:30.716034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-153fcb76-595c-4a6c-a9f5-d9bb3e22da56 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:30.716649 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-153fcb76-595c-4a6c-a9f5-d9bb3e22da56 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:30.723727 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-153fcb76-595c-4a6c-a9f5-d9bb3e22da56 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:30.724424 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-153fcb76-595c-4a6c-a9f5-d9bb3e22da56 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:30.725591 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-153fcb76-595c-4a6c-a9f5-d9bb3e22da56 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:30.726026 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-153fcb76-595c-4a6c-a9f5-d9bb3e22da56 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:30.975852 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6d088284-0dea-45dc-a8da-4064820d17b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:30.982409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-153fcb76-595c-4a6c-a9f5-d9bb3e22da56 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:30.983682 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6d088284-0dea-45dc-a8da-4064820d17b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1361 microversion: 2.1 time: 0.308247 May 17 22:14:30.984258 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 440/854] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:30 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:30.993988 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-153fcb76-595c-4a6c-a9f5-d9bb3e22da56 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1691 microversion: 2.1 time: 0.281887 May 17 22:14:30.994569 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 415/855] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:30 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1691 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:31.527171 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-232920d5-e912-43e7-8368-57936906ca1a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:31.528702 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-232920d5-e912-43e7-8368-57936906ca1a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:31.536776 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-232920d5-e912-43e7-8368-57936906ca1a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:31.537366 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-232920d5-e912-43e7-8368-57936906ca1a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:31.538434 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-232920d5-e912-43e7-8368-57936906ca1a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:31.538968 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-232920d5-e912-43e7-8368-57936906ca1a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:31.873322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-232920d5-e912-43e7-8368-57936906ca1a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:31.883481 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-232920d5-e912-43e7-8368-57936906ca1a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:31.887664 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-232920d5-e912-43e7-8368-57936906ca1a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:31.887664 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-232920d5-e912-43e7-8368-57936906ca1a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1405 microversion: 2.20 time: 0.364614 May 17 22:14:31.901896 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 441/856] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:31 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1405 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:32.020544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8953d1d2-ae8f-4fbb-bee1-6c33fc369f85 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:32.020544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8953d1d2-ae8f-4fbb-bee1-6c33fc369f85 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:32.020544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8953d1d2-ae8f-4fbb-bee1-6c33fc369f85 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:32.020544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8953d1d2-ae8f-4fbb-bee1-6c33fc369f85 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:32.021300 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8953d1d2-ae8f-4fbb-bee1-6c33fc369f85 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:32.021300 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8953d1d2-ae8f-4fbb-bee1-6c33fc369f85 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:32.021456 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-779d51e4-bd71-4e2b-b5d4-a04f15dba881 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:32.021456 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-779d51e4-bd71-4e2b-b5d4-a04f15dba881 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:32.032188 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-779d51e4-bd71-4e2b-b5d4-a04f15dba881 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:32.033217 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-779d51e4-bd71-4e2b-b5d4-a04f15dba881 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:32.033474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-779d51e4-bd71-4e2b-b5d4-a04f15dba881 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:32.033920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-779d51e4-bd71-4e2b-b5d4-a04f15dba881 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:32.873282 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-779d51e4-bd71-4e2b-b5d4-a04f15dba881 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:32.881657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-779d51e4-bd71-4e2b-b5d4-a04f15dba881 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1691 microversion: 2.1 time: 0.873092 May 17 22:14:32.892819 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 442/857] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:32 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1691 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:14:32.906328 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d00e6224-f0a2-4135-9caf-fd389de741ec tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:32.907190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d00e6224-f0a2-4135-9caf-fd389de741ec tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:32.914681 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8953d1d2-ae8f-4fbb-bee1-6c33fc369f85 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:32.926196 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8953d1d2-ae8f-4fbb-bee1-6c33fc369f85 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1361 microversion: 2.1 time: 0.928222 May 17 22:14:32.938575 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d00e6224-f0a2-4135-9caf-fd389de741ec tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:32.940751 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 416/858] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:31 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1361 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:32.943597 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d00e6224-f0a2-4135-9caf-fd389de741ec tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:32.944601 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d00e6224-f0a2-4135-9caf-fd389de741ec tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:32.945272 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d00e6224-f0a2-4135-9caf-fd389de741ec tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:33.328781 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d00e6224-f0a2-4135-9caf-fd389de741ec tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:33.350409 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d00e6224-f0a2-4135-9caf-fd389de741ec tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:33.352999 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d00e6224-f0a2-4135-9caf-fd389de741ec tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:33.354683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d00e6224-f0a2-4135-9caf-fd389de741ec tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1405 microversion: 2.20 time: 0.452558 May 17 22:14:33.355920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 443/859] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:32 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:14:33.900350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1ec4443b-f0fd-4867-87a3-05223bf8c077 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:33.901077 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1ec4443b-f0fd-4867-87a3-05223bf8c077 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:33.908447 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1ec4443b-f0fd-4867-87a3-05223bf8c077 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:33.915907 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1ec4443b-f0fd-4867-87a3-05223bf8c077 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:33.917319 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1ec4443b-f0fd-4867-87a3-05223bf8c077 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:33.917966 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1ec4443b-f0fd-4867-87a3-05223bf8c077 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:33.949319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ca2cba91-54a7-40e7-a9fd-a355302ff572 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:33.957285 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ca2cba91-54a7-40e7-a9fd-a355302ff572 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:33.962184 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ca2cba91-54a7-40e7-a9fd-a355302ff572 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:33.963505 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ca2cba91-54a7-40e7-a9fd-a355302ff572 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:33.966203 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ca2cba91-54a7-40e7-a9fd-a355302ff572 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:33.966937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ca2cba91-54a7-40e7-a9fd-a355302ff572 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:34.134727 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1ec4443b-f0fd-4867-87a3-05223bf8c077 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:34.152535 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1ec4443b-f0fd-4867-87a3-05223bf8c077 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1623 microversion: 2.1 time: 0.256954 May 17 22:14:34.154759 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 417/860] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:33 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1623 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:34.293662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-abb39a7b-a822-4a4f-babf-ac1a7c866cb0 req-b87ddbdd-cd97-435c-bdd6-197d37e75cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3e521e-c843-4727-8c31-00c86e4e6aa0", "name": "network-vif-deleted", "tag": "ea82fbfe-827c-4d08-a78d-a544d7f86c1c"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:34.314081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-abb39a7b-a822-4a4f-babf-ac1a7c866cb0 req-b87ddbdd-cd97-435c-bdd6-197d37e75cd2 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:34.314614 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-abb39a7b-a822-4a4f-babf-ac1a7c866cb0 req-b87ddbdd-cd97-435c-bdd6-197d37e75cd2 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:34.361953 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-abb39a7b-a822-4a4f-babf-ac1a7c866cb0 req-b87ddbdd-cd97-435c-bdd6-197d37e75cd2 service nova] Creating event network-vif-deleted:ea82fbfe-827c-4d08-a78d-a544d7f86c1c for instance da3e521e-c843-4727-8c31-00c86e4e6aa0 on hv-cinder-83998 May 17 22:14:34.369384 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-abb39a7b-a822-4a4f-babf-ac1a7c866cb0 req-b87ddbdd-cd97-435c-bdd6-197d37e75cd2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079426 May 17 22:14:34.370015 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 418/861] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:34.377437 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-21e27ea8-47dc-4150-9e8b-c6f291b36898 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:34.379025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-21e27ea8-47dc-4150-9e8b-c6f291b36898 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:34.406141 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-21e27ea8-47dc-4150-9e8b-c6f291b36898 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:34.408392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-21e27ea8-47dc-4150-9e8b-c6f291b36898 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:34.409211 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-21e27ea8-47dc-4150-9e8b-c6f291b36898 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:34.410116 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-21e27ea8-47dc-4150-9e8b-c6f291b36898 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:34.437957 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ca2cba91-54a7-40e7-a9fd-a355302ff572 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:34.467455 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ca2cba91-54a7-40e7-a9fd-a355302ff572 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1361 microversion: 2.1 time: 0.522615 May 17 22:14:34.468796 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 444/862] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:33 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1361 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:34.722612 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-21e27ea8-47dc-4150-9e8b-c6f291b36898 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:34.748312 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-21e27ea8-47dc-4150-9e8b-c6f291b36898 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:34.750562 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-21e27ea8-47dc-4150-9e8b-c6f291b36898 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:34.755163 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-21e27ea8-47dc-4150-9e8b-c6f291b36898 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1595 microversion: 2.20 time: 0.379179 May 17 22:14:34.756874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 419/863] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:14:34 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1595 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:14:34.777618 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ad52ebe4-e46d-4267-b203-19335e07bdca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:34.778353 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ad52ebe4-e46d-4267-b203-19335e07bdca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:34.787138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad52ebe4-e46d-4267-b203-19335e07bdca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:34.788040 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad52ebe4-e46d-4267-b203-19335e07bdca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:34.789187 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad52ebe4-e46d-4267-b203-19335e07bdca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:34.789789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad52ebe4-e46d-4267-b203-19335e07bdca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:34.877146 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ad52ebe4-e46d-4267-b203-19335e07bdca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103557 May 17 22:14:34.877778 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 445/864] 10.222.0.24 () {60 vars in 1315 bytes} [Tue May 17 22:14:34 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:14:35.170101 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-977ade9d-ab87-4bae-87a3-666d3dcd7dc5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:35.170717 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-977ade9d-ab87-4bae-87a3-666d3dcd7dc5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:35.179423 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-977ade9d-ab87-4bae-87a3-666d3dcd7dc5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:35.182713 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-977ade9d-ab87-4bae-87a3-666d3dcd7dc5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:35.182713 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-977ade9d-ab87-4bae-87a3-666d3dcd7dc5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:35.182713 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-977ade9d-ab87-4bae-87a3-666d3dcd7dc5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:35.227679 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-977ade9d-ab87-4bae-87a3-666d3dcd7dc5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:35.227679 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-977ade9d-ab87-4bae-87a3-666d3dcd7dc5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:35.227679 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-977ade9d-ab87-4bae-87a3-666d3dcd7dc5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lazy-loading 'fault' on Instance uuid da3e521e-c843-4727-8c31-00c86e4e6aa0 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:14:35.349698 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-977ade9d-ab87-4bae-87a3-666d3dcd7dc5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:35.365175 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-977ade9d-ab87-4bae-87a3-666d3dcd7dc5 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 200 len: 1336 microversion: 2.1 time: 0.198943 May 17 22:14:35.375057 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 420/865] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:35 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 1336 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:35.485419 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-22c1627f-db5e-45f1-baaa-b26479f930f0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:35.486209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-22c1627f-db5e-45f1-baaa-b26479f930f0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:35.494920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-22c1627f-db5e-45f1-baaa-b26479f930f0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:35.495548 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-22c1627f-db5e-45f1-baaa-b26479f930f0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:35.499716 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-22c1627f-db5e-45f1-baaa-b26479f930f0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:35.507092 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-22c1627f-db5e-45f1-baaa-b26479f930f0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:35.813965 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-22c1627f-db5e-45f1-baaa-b26479f930f0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:35.824484 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-22c1627f-db5e-45f1-baaa-b26479f930f0 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1547 microversion: 2.1 time: 0.341319 May 17 22:14:35.825111 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 446/866] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:35 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1547 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:35.847216 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-88847294-acfb-4ca7-8388-0273dc95306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:35.847216 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-88847294-acfb-4ca7-8388-0273dc95306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:35.854508 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-88847294-acfb-4ca7-8388-0273dc95306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:35.854963 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-88847294-acfb-4ca7-8388-0273dc95306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:35.857742 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-88847294-acfb-4ca7-8388-0273dc95306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:35.858196 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-88847294-acfb-4ca7-8388-0273dc95306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:36.003794 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-88847294-acfb-4ca7-8388-0273dc95306b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162660 May 17 22:14:36.009511 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 421/867] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 17 22:14:35 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:36.382259 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a5178852-eed0-4804-a94a-7f1f642feb13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:36.383008 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a5178852-eed0-4804-a94a-7f1f642feb13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: da3e521e-c843-4727-8c31-00c86e4e6aa0] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:36.388996 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5178852-eed0-4804-a94a-7f1f642feb13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:36.389675 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5178852-eed0-4804-a94a-7f1f642feb13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:36.390440 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5178852-eed0-4804-a94a-7f1f642feb13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:36.390869 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a5178852-eed0-4804-a94a-7f1f642feb13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:36.405640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-a5178852-eed0-4804-a94a-7f1f642feb13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] HTTP exception thrown: Instance da3e521e-c843-4727-8c31-00c86e4e6aa0 could not be found. May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a5178852-eed0-4804-a94a-7f1f642feb13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Request method failure captured: May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 HTTP/1.1 May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0P0UB5_uQfKTuVZPhH7DNkYAdH4uRgkhSs_b6rbwPZ_1fapkgG_r3KdEbs4XGm2C_Rp1CTTOgvsoNQrwuCSt2PBbkFf06sbYA1Ukg8-odEmBZ2p0sSFzwtGdwavI4iQdBU7car_6jAD2weQQcjBgdczxsrbNA_K4dLU0356ZlF5Ao May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 7a0d6701b5d5441eb7eaf815d273d4d9 May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:14:36.407343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:14:36.409017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7a0d6701b5d5441eb7eaf815d273d4d9", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:14:36.409017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:14:36.409017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 7a0d6701b5d5441eb7eaf815d273d4d9 May 17 22:14:36.409017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:14:36.409017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-ServerRescueNegativeTestJSON-127931416-project May 17 22:14:36.409017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:14:36.409017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:14:36.409017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 8cc69cd4250c436e8b893887604b2273 May 17 22:14:36.409017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-127931416-project May 17 22:14:36.409017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:14:36.409017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance da3e521e-c843-4727-8c31-00c86e4e6aa0 could not be found. May 17 22:14:36.409017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': 'da3e521e-c843-4727-8c31-00c86e4e6aa0'} May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3e521e-c843-4727-8c31-00c86e4e6aa0 could not be found. May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:14:36.410165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3e521e-c843-4727-8c31-00c86e4e6aa0 could not be found. May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3e521e-c843-4727-8c31-00c86e4e6aa0 could not be found. May 17 22:14:36.411704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:36.413144 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a5178852-eed0-4804-a94a-7f1f642feb13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Returning 404 to user: Instance da3e521e-c843-4727-8c31-00c86e4e6aa0 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:14:36.413144 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a5178852-eed0-4804-a94a-7f1f642feb13 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0" status: 404 len: 111 microversion: 2.1 time: 0.030777 May 17 22:14:36.413144 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 447/868] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:36 2022] GET /compute/v2.1/servers/da3e521e-c843-4727-8c31-00c86e4e6aa0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:14:36.422677 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-546649d2-812e-4dd2-91cf-f81cff504086 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '.version_select at 0x7f09f1f55160>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:36.515504 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-546649d2-812e-4dd2-91cf-f81cff504086 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562254185" status: 202 len: 0 microversion: 2.1 time: 0.096696 May 17 22:14:36.521040 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 422/869] 10.222.0.24 () {58 vars in 1220 bytes} [Tue May 17 22:14:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562254185 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:14:37.040679 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-4cc995b0-ceae-4d8b-bb51-9016e92deae9 req-8f589f0d-d5d6-4cd0-8ce9-58bcd506cac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c", "tag": "01f9ff90-5b71-4555-bb92-f5d36e9518eb"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:37.049661 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-4cc995b0-ceae-4d8b-bb51-9016e92deae9 req-8f589f0d-d5d6-4cd0-8ce9-58bcd506cac0 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:37.050121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-4cc995b0-ceae-4d8b-bb51-9016e92deae9 req-8f589f0d-d5d6-4cd0-8ce9-58bcd506cac0 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:37.064375 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-4cc995b0-ceae-4d8b-bb51-9016e92deae9 req-8f589f0d-d5d6-4cd0-8ce9-58bcd506cac0 service nova] Creating event network-changed:01f9ff90-5b71-4555-bb92-f5d36e9518eb for instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c on hv-cinder-83998 May 17 22:14:37.071062 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-4cc995b0-ceae-4d8b-bb51-9016e92deae9 req-8f589f0d-d5d6-4cd0-8ce9-58bcd506cac0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034147 May 17 22:14:37.071804 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 448/870] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:14:38.160589 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-821fab88-86f4-4631-b981-eb95f55a2aca tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Action: 'create', calling method: .version_select at 0x7f09f1febf70>, body: {"keypair": {"name": "tempest-TestShelveInstance-925432835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGZrzYlmSRSh1T65ya2plFjxV8C1RC2TLSI2OWwq13odJ6/oRmzaOkwhngDMJ4Oa1m0k2ZfJkYCoLI3QtBm0o9IrFSDHg/q5toJWxgzKxXfSlwq6HLW6wyAZwl6j4d+pQ=="}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:38.178427 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-821fab88-86f4-4631-b981-eb95f55a2aca tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Getting quotas for project 74eb5524f74d434b87ff129f9997176b. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:14:38.183891 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-821fab88-86f4-4631-b981-eb95f55a2aca tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Getting quotas for user 692710d8062c42b5a7fabf677bce0598 and project 74eb5524f74d434b87ff129f9997176b. Resources: {'key_pairs'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:14:38.271879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-821fab88-86f4-4631-b981-eb95f55a2aca tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.364223 May 17 22:14:38.276745 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 423/871] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 17 22:14:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:39.087261 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-aa458caa-e8da-4d11-83d4-d8a80a98860a req-6b0b3221-9a5c-49f8-8a12-64bbbbf8d876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4d36e2-0f10-4434-ad5d-cc27b81e923e", "tag": "2c450f46-d2e6-4987-8fa7-2c91fde11f5b"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:39.097326 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-aa458caa-e8da-4d11-83d4-d8a80a98860a req-6b0b3221-9a5c-49f8-8a12-64bbbbf8d876 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:39.097782 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-aa458caa-e8da-4d11-83d4-d8a80a98860a req-6b0b3221-9a5c-49f8-8a12-64bbbbf8d876 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:39.109888 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-aa458caa-e8da-4d11-83d4-d8a80a98860a req-6b0b3221-9a5c-49f8-8a12-64bbbbf8d876 service nova] Creating event network-changed:2c450f46-d2e6-4987-8fa7-2c91fde11f5b for instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e on hv-cinder-83998 May 17 22:14:39.115724 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-aa458caa-e8da-4d11-83d4-d8a80a98860a req-6b0b3221-9a5c-49f8-8a12-64bbbbf8d876 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032036 May 17 22:14:39.116298 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 449/872] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:41.534065 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7211cdd4-3778-4555-897a-5243002dcb26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:41.535809 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7211cdd4-3778-4555-897a-5243002dcb26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:41.542393 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7211cdd4-3778-4555-897a-5243002dcb26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:41.542841 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7211cdd4-3778-4555-897a-5243002dcb26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:41.543736 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7211cdd4-3778-4555-897a-5243002dcb26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:41.544181 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7211cdd4-3778-4555-897a-5243002dcb26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:41.570739 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7211cdd4-3778-4555-897a-5243002dcb26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:14:41.899412 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7211cdd4-3778-4555-897a-5243002dcb26 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "DELETE /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 204 len: 0 microversion: 2.1 time: 0.369484 May 17 22:14:41.903258 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 424/873] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:14:41 2022] DELETE /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:14:41.913470 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1a9cb8bd-bc1e-4af8-b821-a257234a6959 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:41.914163 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1a9cb8bd-bc1e-4af8-b821-a257234a6959 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:41.924227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a9cb8bd-bc1e-4af8-b821-a257234a6959 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:41.924690 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a9cb8bd-bc1e-4af8-b821-a257234a6959 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:41.926053 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a9cb8bd-bc1e-4af8-b821-a257234a6959 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:41.926495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1a9cb8bd-bc1e-4af8-b821-a257234a6959 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:42.078826 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1a9cb8bd-bc1e-4af8-b821-a257234a6959 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:42.087384 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1a9cb8bd-bc1e-4af8-b821-a257234a6959 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1508 microversion: 2.1 time: 0.182699 May 17 22:14:42.087910 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 450/874] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:41 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:42.677317 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a668f536-8bbd-4986-b772-65eb2301cb0d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:42.677886 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a668f536-8bbd-4986-b772-65eb2301cb0d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:42.685796 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a668f536-8bbd-4986-b772-65eb2301cb0d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:42.686864 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a668f536-8bbd-4986-b772-65eb2301cb0d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:42.688204 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a668f536-8bbd-4986-b772-65eb2301cb0d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:42.689162 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a668f536-8bbd-4986-b772-65eb2301cb0d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:42.734127 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a668f536-8bbd-4986-b772-65eb2301cb0d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/ips" status: 200 len: 151 microversion: 2.1 time: 0.191160 May 17 22:14:42.734799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 425/875] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 17 22:14:42 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/ips => generated 151 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:43.104649 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dccccf1a-8001-4316-a1e7-b942157088af tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:43.105363 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dccccf1a-8001-4316-a1e7-b942157088af tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:43.114592 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dccccf1a-8001-4316-a1e7-b942157088af tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:43.115042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dccccf1a-8001-4316-a1e7-b942157088af tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:43.115884 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dccccf1a-8001-4316-a1e7-b942157088af tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:43.116314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dccccf1a-8001-4316-a1e7-b942157088af tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:43.255096 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-dccccf1a-8001-4316-a1e7-b942157088af tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:43.262789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dccccf1a-8001-4316-a1e7-b942157088af tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1508 microversion: 2.1 time: 0.162205 May 17 22:14:43.263454 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 451/876] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:43 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:44.280820 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6171fce3-2268-4cfb-8978-cda3a2be2db2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:44.281423 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6171fce3-2268-4cfb-8978-cda3a2be2db2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:44.292969 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6171fce3-2268-4cfb-8978-cda3a2be2db2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:44.293842 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6171fce3-2268-4cfb-8978-cda3a2be2db2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:44.294805 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6171fce3-2268-4cfb-8978-cda3a2be2db2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:44.295279 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6171fce3-2268-4cfb-8978-cda3a2be2db2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:44.458308 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-73acd926-3c5a-4b98-8c8a-9b101471fa56 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18008544-bdf6-49cd-87b4-124c37d4c35f"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:44.460660 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-73acd926-3c5a-4b98-8c8a-9b101471fa56 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:44.470306 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-73acd926-3c5a-4b98-8c8a-9b101471fa56 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:44.471076 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-73acd926-3c5a-4b98-8c8a-9b101471fa56 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:44.475321 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-73acd926-3c5a-4b98-8c8a-9b101471fa56 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:44.476008 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-73acd926-3c5a-4b98-8c8a-9b101471fa56 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:44.507485 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6171fce3-2268-4cfb-8978-cda3a2be2db2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:44.516624 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6171fce3-2268-4cfb-8978-cda3a2be2db2 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1508 microversion: 2.1 time: 0.239239 May 17 22:14:44.517216 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 426/877] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:44 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:44.532357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-2d486942-3b8e-49e7-b54b-51920cb6d40a req-82e4ac8f-3ddd-4feb-a253-a73e13da3282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f605a2f-287e-4adb-8178-2e2a76f6303f", "name": "network-vif-deleted", "tag": "2f43fb3e-b8f4-499d-888d-e9a598121d47"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:44.541803 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-2d486942-3b8e-49e7-b54b-51920cb6d40a req-82e4ac8f-3ddd-4feb-a253-a73e13da3282 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:44.542252 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-2d486942-3b8e-49e7-b54b-51920cb6d40a req-82e4ac8f-3ddd-4feb-a253-a73e13da3282 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:44.555262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-2d486942-3b8e-49e7-b54b-51920cb6d40a req-82e4ac8f-3ddd-4feb-a253-a73e13da3282 service nova] Creating event network-vif-deleted:2f43fb3e-b8f4-499d-888d-e9a598121d47 for instance 0f605a2f-287e-4adb-8178-2e2a76f6303f on hv-cinder-83998 May 17 22:14:44.562513 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-2d486942-3b8e-49e7-b54b-51920cb6d40a req-82e4ac8f-3ddd-4feb-a253-a73e13da3282 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032017 May 17 22:14:44.563162 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 427/878] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:45.240411 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-73acd926-3c5a-4b98-8c8a-9b101471fa56 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.789237 May 17 22:14:45.241178 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 452/879] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:14:44 2022] POST /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-volume_attachments => generated 194 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:14:45.535008 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4cc59c3f-8b06-4fe5-8cff-96f2ea518c5f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:45.557259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4cc59c3f-8b06-4fe5-8cff-96f2ea518c5f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:45.557259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cc59c3f-8b06-4fe5-8cff-96f2ea518c5f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:45.557259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cc59c3f-8b06-4fe5-8cff-96f2ea518c5f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:45.557259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cc59c3f-8b06-4fe5-8cff-96f2ea518c5f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:45.557883 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cc59c3f-8b06-4fe5-8cff-96f2ea518c5f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:45.578502 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cc59c3f-8b06-4fe5-8cff-96f2ea518c5f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:45.579294 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cc59c3f-8b06-4fe5-8cff-96f2ea518c5f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:45.579788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-4cc59c3f-8b06-4fe5-8cff-96f2ea518c5f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lazy-loading 'fault' on Instance uuid 0f605a2f-287e-4adb-8178-2e2a76f6303f {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:14:45.627746 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4cc59c3f-8b06-4fe5-8cff-96f2ea518c5f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:45.636941 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4cc59c3f-8b06-4fe5-8cff-96f2ea518c5f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 200 len: 1312 microversion: 2.1 time: 0.106641 May 17 22:14:45.637462 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 428/880] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:45 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:45.942253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-774d9b14-1dfa-4b33-9655-920160654ce3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1021890707"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:45.942896 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-774d9b14-1dfa-4b33-9655-920160654ce3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:45.949113 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-774d9b14-1dfa-4b33-9655-920160654ce3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:45.949744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-774d9b14-1dfa-4b33-9655-920160654ce3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:45.950407 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-774d9b14-1dfa-4b33-9655-920160654ce3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:45.950841 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-774d9b14-1dfa-4b33-9655-920160654ce3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:46.086678 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.network.security_group_api [None req-774d9b14-1dfa-4b33-9655-920160654ce3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Removing security group 6bbd6b68-fd1b-4a30-8743-d3d3eede093c from port 6b82dab7-02cb-4cc1-a078-91095811826f May 17 22:14:46.548029 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-774d9b14-1dfa-4b33-9655-920160654ce3 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "POST /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/action" status: 202 len: 0 microversion: 2.1 time: 0.611268 May 17 22:14:46.554764 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 453/881] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:14:45 2022] POST /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:14:46.582933 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-68fa128a-216f-4423-a4ca-eccbdabefdf8 req-036fcb70-5b4f-447c-a810-a8f763eb5318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c468659-e42a-4284-9a0c-39aa262bd9a5", "tag": "6b82dab7-02cb-4cc1-a078-91095811826f"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:46.592666 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-68fa128a-216f-4423-a4ca-eccbdabefdf8 req-036fcb70-5b4f-447c-a810-a8f763eb5318 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:46.593346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-68fa128a-216f-4423-a4ca-eccbdabefdf8 req-036fcb70-5b4f-447c-a810-a8f763eb5318 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:46.605795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-68fa128a-216f-4423-a4ca-eccbdabefdf8 req-036fcb70-5b4f-447c-a810-a8f763eb5318 service nova] Creating event network-changed:6b82dab7-02cb-4cc1-a078-91095811826f for instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 on hv-cinder-83998 May 17 22:14:46.611626 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-68fa128a-216f-4423-a4ca-eccbdabefdf8 req-036fcb70-5b4f-447c-a810-a8f763eb5318 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034651 May 17 22:14:46.612990 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 429/882] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:46.655833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-328bea1d-fb38-4527-acfe-27a1f5e4dd0b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:46.656303 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-328bea1d-fb38-4527-acfe-27a1f5e4dd0b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 0f605a2f-287e-4adb-8178-2e2a76f6303f] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:46.671753 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-328bea1d-fb38-4527-acfe-27a1f5e4dd0b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:46.672730 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-328bea1d-fb38-4527-acfe-27a1f5e4dd0b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:46.681457 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-328bea1d-fb38-4527-acfe-27a1f5e4dd0b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:46.682285 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-328bea1d-fb38-4527-acfe-27a1f5e4dd0b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:46.704890 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-328bea1d-fb38-4527-acfe-27a1f5e4dd0b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] HTTP exception thrown: Instance 0f605a2f-287e-4adb-8178-2e2a76f6303f could not be found. May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-328bea1d-fb38-4527-acfe-27a1f5e4dd0b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Request method failure captured: May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f HTTP/1.1 May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0P0UB5_uQfKTuVZPhH7DNkYAdH4uRgkhSs_b6rbwPZ_1fapkgG_r3KdEbs4XGm2C_Rp1CTTOgvsoNQrwuCSt2PBbkFf06sbYA1Ukg8-odEmBZ2p0sSFzwtGdwavI4iQdBU7car_6jAD2weQQcjBgdczxsrbNA_K4dLU0356ZlF5Ao May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 7a0d6701b5d5441eb7eaf815d273d4d9 May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:14:46.709227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:14:46.710963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7a0d6701b5d5441eb7eaf815d273d4d9", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:14:46.710963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:14:46.710963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 7a0d6701b5d5441eb7eaf815d273d4d9 May 17 22:14:46.710963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:14:46.710963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-ServerRescueNegativeTestJSON-127931416-project May 17 22:14:46.710963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:14:46.710963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:14:46.710963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 8cc69cd4250c436e8b893887604b2273 May 17 22:14:46.710963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-127931416-project May 17 22:14:46.710963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:14:46.710963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 0f605a2f-287e-4adb-8178-2e2a76f6303f could not be found. May 17 22:14:46.710963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '0f605a2f-287e-4adb-8178-2e2a76f6303f'} May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f605a2f-287e-4adb-8178-2e2a76f6303f could not be found. May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:14:46.711937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f605a2f-287e-4adb-8178-2e2a76f6303f could not be found. May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f605a2f-287e-4adb-8178-2e2a76f6303f could not be found. May 17 22:14:46.713376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:14:46.718357 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-328bea1d-fb38-4527-acfe-27a1f5e4dd0b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Returning 404 to user: Instance 0f605a2f-287e-4adb-8178-2e2a76f6303f could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:14:46.719470 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-328bea1d-fb38-4527-acfe-27a1f5e4dd0b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f" status: 404 len: 111 microversion: 2.1 time: 0.067915 May 17 22:14:46.725812 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 454/883] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:46 2022] GET /compute/v2.1/servers/0f605a2f-287e-4adb-8178-2e2a76f6303f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:14:46.731411 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ff6d83da-ad04-44c8-909c-a57e95aa0fca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:46.732063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ff6d83da-ad04-44c8-909c-a57e95aa0fca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:46.738871 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ff6d83da-ad04-44c8-909c-a57e95aa0fca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:46.739348 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ff6d83da-ad04-44c8-909c-a57e95aa0fca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:46.740136 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ff6d83da-ad04-44c8-909c-a57e95aa0fca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:46.740567 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ff6d83da-ad04-44c8-909c-a57e95aa0fca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:46.791587 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ff6d83da-ad04-44c8-909c-a57e95aa0fca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:14:47.093333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ff6d83da-ad04-44c8-909c-a57e95aa0fca tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "DELETE /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 204 len: 0 microversion: 2.1 time: 0.365989 May 17 22:14:47.093928 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 430/884] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:14:46 2022] DELETE /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:14:47.103224 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9f52c96b-1820-49db-ab84-e29ee4501eed tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:47.104079 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9f52c96b-1820-49db-ab84-e29ee4501eed tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:47.110514 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9f52c96b-1820-49db-ab84-e29ee4501eed tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:47.111087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9f52c96b-1820-49db-ab84-e29ee4501eed tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:47.111961 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9f52c96b-1820-49db-ab84-e29ee4501eed tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:47.112396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9f52c96b-1820-49db-ab84-e29ee4501eed tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:47.276700 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9f52c96b-1820-49db-ab84-e29ee4501eed tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:47.284488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9f52c96b-1820-49db-ab84-e29ee4501eed tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.185169 May 17 22:14:47.285195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 455/885] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:47 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:48.078307 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4da1ff04-ac39-48a6-9d6a-d51ab2d67f44 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:48.078891 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4da1ff04-ac39-48a6-9d6a-d51ab2d67f44 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:48.086444 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4da1ff04-ac39-48a6-9d6a-d51ab2d67f44 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:48.087058 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4da1ff04-ac39-48a6-9d6a-d51ab2d67f44 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:48.087915 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4da1ff04-ac39-48a6-9d6a-d51ab2d67f44 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:48.088576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4da1ff04-ac39-48a6-9d6a-d51ab2d67f44 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:48.152001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-02a66cfa-2820-46de-b8a2-c5979035970e req-6187f306-7538-411a-a225-f29890ebfd14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c468659-e42a-4284-9a0c-39aa262bd9a5", "tag": "6b82dab7-02cb-4cc1-a078-91095811826f"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:48.163240 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-02a66cfa-2820-46de-b8a2-c5979035970e req-6187f306-7538-411a-a225-f29890ebfd14 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:48.165278 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-02a66cfa-2820-46de-b8a2-c5979035970e req-6187f306-7538-411a-a225-f29890ebfd14 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:48.177406 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-02a66cfa-2820-46de-b8a2-c5979035970e req-6187f306-7538-411a-a225-f29890ebfd14 service nova] Creating event network-changed:6b82dab7-02cb-4cc1-a078-91095811826f for instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 on hv-cinder-83998 May 17 22:14:48.182697 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-02a66cfa-2820-46de-b8a2-c5979035970e req-6187f306-7538-411a-a225-f29890ebfd14 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099384 May 17 22:14:48.183779 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 456/886] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:48.190599 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-4da1ff04-ac39-48a6-9d6a-d51ab2d67f44 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lazy-loading 'services' on Instance uuid 4c468659-e42a-4284-9a0c-39aa262bd9a5 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:14:48.302628 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6189728c-f6bf-402c-a2c2-73d92720299f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:48.303356 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6189728c-f6bf-402c-a2c2-73d92720299f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:48.310165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6189728c-f6bf-402c-a2c2-73d92720299f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:48.310620 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6189728c-f6bf-402c-a2c2-73d92720299f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:48.311699 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6189728c-f6bf-402c-a2c2-73d92720299f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:48.312141 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6189728c-f6bf-402c-a2c2-73d92720299f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:48.390425 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4da1ff04-ac39-48a6-9d6a-d51ab2d67f44 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments/4866bd78-7ea6-4d4b-84e3-d2b55d401ea5" status: 202 len: 0 microversion: 2.1 time: 0.316173 May 17 22:14:48.391377 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 431/887] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 17 22:14:48 2022] DELETE /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments/4866bd78-7ea6-4d4b-84e3-d2b55d401ea5 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:14:48.400718 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7420cdd3-a156-4be6-bea7-dcdca41d145c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:48.401705 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7420cdd3-a156-4be6-bea7-dcdca41d145c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:48.412595 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7420cdd3-a156-4be6-bea7-dcdca41d145c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:48.413096 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7420cdd3-a156-4be6-bea7-dcdca41d145c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:48.413842 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7420cdd3-a156-4be6-bea7-dcdca41d145c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:48.415018 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7420cdd3-a156-4be6-bea7-dcdca41d145c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:48.453742 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7420cdd3-a156-4be6-bea7-dcdca41d145c tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057253 May 17 22:14:48.454328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 432/888] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:48 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:14:48.456777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6189728c-f6bf-402c-a2c2-73d92720299f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:48.465217 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6189728c-f6bf-402c-a2c2-73d92720299f tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.166226 May 17 22:14:48.466648 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 457/889] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:48 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:14:49.465954 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1371bc30-983e-4b06-8065-4dd451ce0fc9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:49.466859 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1371bc30-983e-4b06-8065-4dd451ce0fc9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:49.473543 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1371bc30-983e-4b06-8065-4dd451ce0fc9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:49.473982 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1371bc30-983e-4b06-8065-4dd451ce0fc9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:49.474738 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1371bc30-983e-4b06-8065-4dd451ce0fc9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:49.475208 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1371bc30-983e-4b06-8065-4dd451ce0fc9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:49.481571 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-11b3f00d-0df6-4ef6-bd0c-714214aae34e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:49.482173 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-11b3f00d-0df6-4ef6-bd0c-714214aae34e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:49.489191 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11b3f00d-0df6-4ef6-bd0c-714214aae34e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:49.489642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11b3f00d-0df6-4ef6-bd0c-714214aae34e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:49.490415 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11b3f00d-0df6-4ef6-bd0c-714214aae34e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:49.490846 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11b3f00d-0df6-4ef6-bd0c-714214aae34e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:49.513259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1371bc30-983e-4b06-8065-4dd451ce0fc9 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051187 May 17 22:14:49.513996 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 433/890] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:49 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:49.632263 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-11b3f00d-0df6-4ef6-bd0c-714214aae34e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:49.639409 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-11b3f00d-0df6-4ef6-bd0c-714214aae34e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.161604 May 17 22:14:49.640297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 458/891] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:49 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:14:50.525087 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0af5e321-2586-4a09-9560-9606536d2b11 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:50.526121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0af5e321-2586-4a09-9560-9606536d2b11 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:50.532773 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0af5e321-2586-4a09-9560-9606536d2b11 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:50.533216 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0af5e321-2586-4a09-9560-9606536d2b11 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:50.533973 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0af5e321-2586-4a09-9560-9606536d2b11 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:50.534405 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0af5e321-2586-4a09-9560-9606536d2b11 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:50.569773 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0af5e321-2586-4a09-9560-9606536d2b11 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048529 May 17 22:14:50.570856 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 434/892] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:50 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:50.656869 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8c6d5278-7dbb-4ece-982e-652f7ba4287e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:50.657477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8c6d5278-7dbb-4ece-982e-652f7ba4287e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:50.667059 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8c6d5278-7dbb-4ece-982e-652f7ba4287e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:50.667059 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8c6d5278-7dbb-4ece-982e-652f7ba4287e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:50.667059 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8c6d5278-7dbb-4ece-982e-652f7ba4287e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:50.667059 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8c6d5278-7dbb-4ece-982e-652f7ba4287e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:50.930195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8c6d5278-7dbb-4ece-982e-652f7ba4287e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:50.938429 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8c6d5278-7dbb-4ece-982e-652f7ba4287e tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1523 microversion: 2.1 time: 0.285314 May 17 22:14:50.938997 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 459/893] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:50 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:51.161417 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-97d81dc7-c971-49be-be4b-cab552f39dfc req-a64865c3-a7cb-4e4f-9b8c-6f6cb0d9138d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485c3cc1-ede2-4e51-ac41-c00abe07926e", "name": "network-vif-deleted", "tag": "43990b62-6cdf-4ffd-9e88-4f471ea665e1"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:51.173196 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-97d81dc7-c971-49be-be4b-cab552f39dfc req-a64865c3-a7cb-4e4f-9b8c-6f6cb0d9138d service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:51.178506 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-97d81dc7-c971-49be-be4b-cab552f39dfc req-a64865c3-a7cb-4e4f-9b8c-6f6cb0d9138d service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:51.187043 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-97d81dc7-c971-49be-be4b-cab552f39dfc req-a64865c3-a7cb-4e4f-9b8c-6f6cb0d9138d service nova] Creating event network-vif-deleted:43990b62-6cdf-4ffd-9e88-4f471ea665e1 for instance 485c3cc1-ede2-4e51-ac41-c00abe07926e on hv-cinder-83998 May 17 22:14:51.192441 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-97d81dc7-c971-49be-be4b-cab552f39dfc req-a64865c3-a7cb-4e4f-9b8c-6f6cb0d9138d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035004 May 17 22:14:51.193039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 435/894] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:51.581858 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9b767186-2add-4f48-8fc8-756f534f42bb tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:51.583740 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9b767186-2add-4f48-8fc8-756f534f42bb tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:51.589898 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b767186-2add-4f48-8fc8-756f534f42bb tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:51.590353 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b767186-2add-4f48-8fc8-756f534f42bb tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:51.591157 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b767186-2add-4f48-8fc8-756f534f42bb tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:51.591892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b767186-2add-4f48-8fc8-756f534f42bb tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:51.624022 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9b767186-2add-4f48-8fc8-756f534f42bb tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046463 May 17 22:14:51.624837 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 460/895] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:51 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:51.956538 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cd2fb1b8-de73-49da-ba6f-dcc7ac2d6325 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:51.957316 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cd2fb1b8-de73-49da-ba6f-dcc7ac2d6325 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:51.963862 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd2fb1b8-de73-49da-ba6f-dcc7ac2d6325 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:51.965225 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd2fb1b8-de73-49da-ba6f-dcc7ac2d6325 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:51.965225 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd2fb1b8-de73-49da-ba6f-dcc7ac2d6325 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:51.965617 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd2fb1b8-de73-49da-ba6f-dcc7ac2d6325 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:51.999932 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd2fb1b8-de73-49da-ba6f-dcc7ac2d6325 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:52.000380 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd2fb1b8-de73-49da-ba6f-dcc7ac2d6325 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:52.000817 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-cd2fb1b8-de73-49da-ba6f-dcc7ac2d6325 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lazy-loading 'fault' on Instance uuid 485c3cc1-ede2-4e51-ac41-c00abe07926e {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:14:52.043742 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cd2fb1b8-de73-49da-ba6f-dcc7ac2d6325 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cc69cd4250c436e8b893887604b2273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0d6701b5d5441eb7eaf815d273d4d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:52.051798 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cd2fb1b8-de73-49da-ba6f-dcc7ac2d6325 tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 200 len: 1312 microversion: 2.1 time: 0.099326 May 17 22:14:52.052369 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 436/896] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:51 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:52.637822 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-03f54fd2-71a6-4c96-9c6b-a39d9bcbdf42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:52.639681 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-03f54fd2-71a6-4c96-9c6b-a39d9bcbdf42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:52.646351 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03f54fd2-71a6-4c96-9c6b-a39d9bcbdf42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:52.646816 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03f54fd2-71a6-4c96-9c6b-a39d9bcbdf42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:52.647742 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03f54fd2-71a6-4c96-9c6b-a39d9bcbdf42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:52.653366 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-03f54fd2-71a6-4c96-9c6b-a39d9bcbdf42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:52.678147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-03f54fd2-71a6-4c96-9c6b-a39d9bcbdf42 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045039 May 17 22:14:52.685215 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 461/897] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:52 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:53.068310 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7c2a313f-1757-46c1-94d0-cc0c1a029e4b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:53.068914 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7c2a313f-1757-46c1-94d0-cc0c1a029e4b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] [instance: 485c3cc1-ede2-4e51-ac41-c00abe07926e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:53.075162 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c2a313f-1757-46c1-94d0-cc0c1a029e4b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:53.075609 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c2a313f-1757-46c1-94d0-cc0c1a029e4b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:53.076364 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c2a313f-1757-46c1-94d0-cc0c1a029e4b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:53.076790 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c2a313f-1757-46c1-94d0-cc0c1a029e4b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:53.089712 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-7c2a313f-1757-46c1-94d0-cc0c1a029e4b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] HTTP exception thrown: Instance 485c3cc1-ede2-4e51-ac41-c00abe07926e could not be found. May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7c2a313f-1757-46c1-94d0-cc0c1a029e4b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Request method failure captured: May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e HTTP/1.1 May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0P0UB5_uQfKTuVZPhH7DNkYAdH4uRgkhSs_b6rbwPZ_1fapkgG_r3KdEbs4XGm2C_Rp1CTTOgvsoNQrwuCSt2PBbkFf06sbYA1Ukg8-odEmBZ2p0sSFzwtGdwavI4iQdBU7car_6jAD2weQQcjBgdczxsrbNA_K4dLU0356ZlF5Ao May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 7a0d6701b5d5441eb7eaf815d273d4d9 May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:14:53.091360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:14:53.093081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7a0d6701b5d5441eb7eaf815d273d4d9", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7a0d6701b5d5441eb7eaf815d273d4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:14:53.093081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:14:53.093081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 7a0d6701b5d5441eb7eaf815d273d4d9 May 17 22:14:53.093081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-127931416 May 17 22:14:53.093081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-ServerRescueNegativeTestJSON-127931416-project May 17 22:14:53.093081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:14:53.093081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:14:53.093081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 8cc69cd4250c436e8b893887604b2273 May 17 22:14:53.093081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-127931416-project May 17 22:14:53.093081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:14:53.093081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 485c3cc1-ede2-4e51-ac41-c00abe07926e could not be found. May 17 22:14:53.093081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '485c3cc1-ede2-4e51-ac41-c00abe07926e'} May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485c3cc1-ede2-4e51-ac41-c00abe07926e could not be found. May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:14:53.094025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485c3cc1-ede2-4e51-ac41-c00abe07926e could not be found. May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485c3cc1-ede2-4e51-ac41-c00abe07926e could not be found. May 17 22:14:53.095544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:53.096861 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7c2a313f-1757-46c1-94d0-cc0c1a029e4b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] Returning 404 to user: Instance 485c3cc1-ede2-4e51-ac41-c00abe07926e could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:14:53.096861 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7c2a313f-1757-46c1-94d0-cc0c1a029e4b tempest-ServerRescueNegativeTestJSON-127931416 tempest-ServerRescueNegativeTestJSON-127931416-project] 10.222.0.24 "GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e" status: 404 len: 111 microversion: 2.1 time: 0.028195 May 17 22:14:53.096861 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 437/898] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:53 2022] GET /compute/v2.1/servers/485c3cc1-ede2-4e51-ac41-c00abe07926e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:14:53.690188 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7f0a5641-3f8e-449f-a002-565d94064908 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:53.693529 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7f0a5641-3f8e-449f-a002-565d94064908 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:53.699761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f0a5641-3f8e-449f-a002-565d94064908 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:53.700220 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f0a5641-3f8e-449f-a002-565d94064908 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:53.700987 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f0a5641-3f8e-449f-a002-565d94064908 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:53.701411 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7f0a5641-3f8e-449f-a002-565d94064908 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:53.731640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7f0a5641-3f8e-449f-a002-565d94064908 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045537 May 17 22:14:53.732427 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 462/899] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:53 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:53.836887 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c74ad670-010e-4a92-86f1-892e1e344985 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18008544-bdf6-49cd-87b4-124c37d4c35f"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:53.838028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c74ad670-010e-4a92-86f1-892e1e344985 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:53.844180 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c74ad670-010e-4a92-86f1-892e1e344985 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:53.844718 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c74ad670-010e-4a92-86f1-892e1e344985 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:53.845578 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c74ad670-010e-4a92-86f1-892e1e344985 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:53.846072 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c74ad670-010e-4a92-86f1-892e1e344985 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:53.928220 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-c74ad670-010e-4a92-86f1-892e1e344985 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Invalid volume: volume 18008544-bdf6-49cd-87b4-124c37d4c35f is already attached to instances: af3dd261-a8e5-4aa9-a950-77e2ce94cc45 May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c74ad670-010e-4a92-86f1-892e1e344985 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: POST /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-volume_attachments HTTP/1.1 May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 74 May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:14:53.929894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:14:53.931576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:14:53.931576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:14:53.931576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:14:53.931576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:14:53.931576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:14:53.931576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:14:53.931576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:14:53.931576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:14:53.931576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:14:53.931576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: May 17 22:14:53.931576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {"volumeAttachment": {"volumeId": "18008544-bdf6-49cd-87b4-124c37d4c35f"}} May 17 22:14:53.931576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Invalid volume: volume 18008544-bdf6-49cd-87b4-124c37d4c35f is already attached to instances: af3dd261-a8e5-4aa9-a950-77e2ce94cc45 May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'server_id': 'af3dd261-a8e5-4aa9-a950-77e2ce94cc45', 'body': {'volumeAttachment': {'volumeId': '18008544-bdf6-49cd-87b4-124c37d4c35f'}}} May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 18008544-bdf6-49cd-87b4-124c37d4c35f is already attached to instances: af3dd261-a8e5-4aa9-a950-77e2ce94cc45 May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:53.932457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 18008544-bdf6-49cd-87b4-124c37d4c35f is already attached to instances: af3dd261-a8e5-4aa9-a950-77e2ce94cc45 May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:53.933913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:53.940643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:53.940643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:14:53.940643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:14:53.940643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 18008544-bdf6-49cd-87b4-124c37d4c35f is already attached to instances: af3dd261-a8e5-4aa9-a950-77e2ce94cc45 May 17 22:14:53.940643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:53.940643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c74ad670-010e-4a92-86f1-892e1e344985 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 400 to user: Invalid volume: volume 18008544-bdf6-49cd-87b4-124c37d4c35f is already attached to instances: af3dd261-a8e5-4aa9-a950-77e2ce94cc45 {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:14:53.940643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c74ad670-010e-4a92-86f1-892e1e344985 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099083 May 17 22:14:53.940643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 438/900] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:14:53 2022] POST /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 22:14:53.998184 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-eb59d30e-28f2-47bf-ac44-c187687ad5e1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:53.998811 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-eb59d30e-28f2-47bf-ac44-c187687ad5e1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:54.005322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eb59d30e-28f2-47bf-ac44-c187687ad5e1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:54.005767 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eb59d30e-28f2-47bf-ac44-c187687ad5e1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:54.006537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eb59d30e-28f2-47bf-ac44-c187687ad5e1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:54.006967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eb59d30e-28f2-47bf-ac44-c187687ad5e1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:54.091508 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.objects.instance [None req-eb59d30e-28f2-47bf-ac44-c187687ad5e1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lazy-loading 'services' on Instance uuid af3dd261-a8e5-4aa9-a950-77e2ce94cc45 {{(pid=117593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:14:54.327257 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-eb59d30e-28f2-47bf-ac44-c187687ad5e1 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-volume_attachments/18008544-bdf6-49cd-87b4-124c37d4c35f" status: 202 len: 0 microversion: 2.1 time: 0.332720 May 17 22:14:54.330568 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 463/901] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 17 22:14:53 2022] DELETE /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-volume_attachments/18008544-bdf6-49cd-87b4-124c37d4c35f => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:14:54.337593 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4d630d1d-8be3-4591-9d5f-8c958992ec26 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:54.339076 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4d630d1d-8be3-4591-9d5f-8c958992ec26 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:54.348637 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d630d1d-8be3-4591-9d5f-8c958992ec26 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:54.349087 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d630d1d-8be3-4591-9d5f-8c958992ec26 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:54.349880 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d630d1d-8be3-4591-9d5f-8c958992ec26 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:54.350312 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d630d1d-8be3-4591-9d5f-8c958992ec26 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:54.382667 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4d630d1d-8be3-4591-9d5f-8c958992ec26 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049990 May 17 22:14:54.383282 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 439/902] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:54 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:14:54.745143 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ddc34ba4-ef03-429d-a925-8d6e1bfa0e8b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:54.746139 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ddc34ba4-ef03-429d-a925-8d6e1bfa0e8b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:54.752206 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ddc34ba4-ef03-429d-a925-8d6e1bfa0e8b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:54.752654 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ddc34ba4-ef03-429d-a925-8d6e1bfa0e8b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:54.753418 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ddc34ba4-ef03-429d-a925-8d6e1bfa0e8b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:54.753852 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ddc34ba4-ef03-429d-a925-8d6e1bfa0e8b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:54.781761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ddc34ba4-ef03-429d-a925-8d6e1bfa0e8b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041360 May 17 22:14:54.782313 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 464/903] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:54 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 17 22:14:54.792741 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-99a68fd8-0486-4c89-be69-c693e92f7311 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:54.793223 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-99a68fd8-0486-4c89-be69-c693e92f7311 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:54.800328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-99a68fd8-0486-4c89-be69-c693e92f7311 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:54.800734 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-99a68fd8-0486-4c89-be69-c693e92f7311 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:54.802545 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-99a68fd8-0486-4c89-be69-c693e92f7311 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:54.802999 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-99a68fd8-0486-4c89-be69-c693e92f7311 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:54.899489 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-99a68fd8-0486-4c89-be69-c693e92f7311 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] HTTP exception thrown: Instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 is not attached to volume 4866bd78-7ea6-4d4b-84e3-d2b55d401ea5 May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-99a68fd8-0486-4c89-be69-c693e92f7311 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Request method failure captured: May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: DELETE /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments/4866bd78-7ea6-4d4b-84e3-d2b55d401ea5 HTTP/1.1 May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB1stDdAI6PgNtstrhkXlcMLzlj5FIzSDa3t56k4hnLcBAyI2bWrSSubA6dKEhYVwblT6efJuowjX5oFJkGCcBgWUCHIpWe8jTaf8XC3m5ZM4_MObVQcCf9eALB5k3Iq7EwbGCTH3v4BOZ8Jyf5rJ6Dh_8BZI2cOS24dwprm7lpODEU May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: f3b9176d44ed415bacfaf45f3f8472a5 May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-TestMinimumBasicScenario-1587986245 May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:14:54.908218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:14:54.909594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f3b9176d44ed415bacfaf45f3f8472a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f3b9176d44ed415bacfaf45f3f8472a5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f3b9176d44ed415bacfaf45f3f8472a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f3b9176d44ed415bacfaf45f3f8472a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:14:54.909594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-TestMinimumBasicScenario-1587986245 May 17 22:14:54.909594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: f3b9176d44ed415bacfaf45f3f8472a5 May 17 22:14:54.909594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1587986245 May 17 22:14:54.909594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-TestMinimumBasicScenario-1587986245-project May 17 22:14:54.909594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:14:54.909594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:14:54.909594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: b1ef9ab26a7442479ec952d43e392081 May 17 22:14:54.909594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-TestMinimumBasicScenario-1587986245-project May 17 22:14:54.909594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:14:54.909594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 is not attached to volume 4866bd78-7ea6-4d4b-84e3-d2b55d401ea5 May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'server_id': '4c468659-e42a-4284-9a0c-39aa262bd9a5', 'id': '4866bd78-7ea6-4d4b-84e3-d2b55d401ea5'} May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4866bd78-7ea6-4d4b-84e3-d2b55d401ea5. May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:14:54.911929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 is not attached to volume 4866bd78-7ea6-4d4b-84e3-d2b55d401ea5 May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 is not attached to volume 4866bd78-7ea6-4d4b-84e3-d2b55d401ea5 May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:14:54.914476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-99a68fd8-0486-4c89-be69-c693e92f7311 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Returning 404 to user: Instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 is not attached to volume 4866bd78-7ea6-4d4b-84e3-d2b55d401ea5 {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:14:54.916730 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-99a68fd8-0486-4c89-be69-c693e92f7311 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments/4866bd78-7ea6-4d4b-84e3-d2b55d401ea5" status: 404 len: 154 microversion: 2.1 time: 0.120868 May 17 22:14:54.916730 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 440/904] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 17 22:14:54 2022] DELETE /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5/os-volume_attachments/4866bd78-7ea6-4d4b-84e3-d2b55d401ea5 => generated 154 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:14:55.402406 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3bca114a-b147-4297-bf84-c87ee5962e8e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:55.403351 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3bca114a-b147-4297-bf84-c87ee5962e8e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:55.417623 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bca114a-b147-4297-bf84-c87ee5962e8e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:55.418173 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bca114a-b147-4297-bf84-c87ee5962e8e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:55.418986 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bca114a-b147-4297-bf84-c87ee5962e8e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:55.424185 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bca114a-b147-4297-bf84-c87ee5962e8e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:55.455950 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3bca114a-b147-4297-bf84-c87ee5962e8e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057540 May 17 22:14:55.456603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 465/905] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:14:55 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 22:14:55.512772 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-85a90996-16c2-4cff-974c-4146725528b0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:55.513271 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-85a90996-16c2-4cff-974c-4146725528b0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:55.520095 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-85a90996-16c2-4cff-974c-4146725528b0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:55.520503 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-85a90996-16c2-4cff-974c-4146725528b0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:55.521357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-85a90996-16c2-4cff-974c-4146725528b0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:55.521796 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-85a90996-16c2-4cff-974c-4146725528b0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:55.547522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-85a90996-16c2-4cff-974c-4146725528b0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:14:55.892958 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-85a90996-16c2-4cff-974c-4146725528b0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 204 len: 0 microversion: 2.1 time: 0.383677 May 17 22:14:55.893550 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 441/906] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:14:55 2022] DELETE /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 22:14:55.902320 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0a294803-019a-48a6-bd8b-b348e2f2603a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:55.903024 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0a294803-019a-48a6-bd8b-b348e2f2603a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:55.909022 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a294803-019a-48a6-bd8b-b348e2f2603a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:55.909460 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a294803-019a-48a6-bd8b-b348e2f2603a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:55.910226 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a294803-019a-48a6-bd8b-b348e2f2603a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:55.911250 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0a294803-019a-48a6-bd8b-b348e2f2603a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:56.117989 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0a294803-019a-48a6-bd8b-b348e2f2603a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:56.125886 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0a294803-019a-48a6-bd8b-b348e2f2603a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1683 microversion: 2.1 time: 0.227091 May 17 22:14:56.127702 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 466/907] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:55 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1683 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:56.193429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6d5c18df-1cfa-4750-9b32-f35e1d9b8249 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:56.194128 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6d5c18df-1cfa-4750-9b32-f35e1d9b8249 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:56.200232 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d5c18df-1cfa-4750-9b32-f35e1d9b8249 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:56.200765 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d5c18df-1cfa-4750-9b32-f35e1d9b8249 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:56.201605 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d5c18df-1cfa-4750-9b32-f35e1d9b8249 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:56.202090 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d5c18df-1cfa-4750-9b32-f35e1d9b8249 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:56.227865 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6d5c18df-1cfa-4750-9b32-f35e1d9b8249 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:14:56.593874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6d5c18df-1cfa-4750-9b32-f35e1d9b8249 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "DELETE /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 204 len: 0 microversion: 2.1 time: 0.404762 May 17 22:14:56.594472 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 442/908] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:14:56 2022] DELETE /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:14:56.603481 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9d2a0a7d-c076-4b7c-8034-23c21d4e787d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:56.604253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9d2a0a7d-c076-4b7c-8034-23c21d4e787d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:56.611137 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d2a0a7d-c076-4b7c-8034-23c21d4e787d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:56.611729 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d2a0a7d-c076-4b7c-8034-23c21d4e787d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:56.612620 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d2a0a7d-c076-4b7c-8034-23c21d4e787d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:56.613607 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d2a0a7d-c076-4b7c-8034-23c21d4e787d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:56.994809 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9d2a0a7d-c076-4b7c-8034-23c21d4e787d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:57.002431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9d2a0a7d-c076-4b7c-8034-23c21d4e787d tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1553 microversion: 2.1 time: 0.402966 May 17 22:14:57.003001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 467/909] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:56 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1553 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:57.144322 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-733182b9-8263-423f-8976-6b3b3e80abf2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:57.145477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-733182b9-8263-423f-8976-6b3b3e80abf2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:57.151355 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-733182b9-8263-423f-8976-6b3b3e80abf2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:57.151801 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-733182b9-8263-423f-8976-6b3b3e80abf2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:57.152572 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-733182b9-8263-423f-8976-6b3b3e80abf2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:57.153005 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-733182b9-8263-423f-8976-6b3b3e80abf2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:57.329917 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-733182b9-8263-423f-8976-6b3b3e80abf2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:57.338261 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-733182b9-8263-423f-8976-6b3b3e80abf2 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1683 microversion: 2.1 time: 0.198174 May 17 22:14:57.338827 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 443/910] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:57 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1683 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:58.019455 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3ebc39cf-f87e-4b8c-99db-69f95ff04b5e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:58.020946 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3ebc39cf-f87e-4b8c-99db-69f95ff04b5e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:58.027262 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3ebc39cf-f87e-4b8c-99db-69f95ff04b5e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:58.027711 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3ebc39cf-f87e-4b8c-99db-69f95ff04b5e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:58.028505 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3ebc39cf-f87e-4b8c-99db-69f95ff04b5e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:58.028938 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3ebc39cf-f87e-4b8c-99db-69f95ff04b5e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:58.164517 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3ebc39cf-f87e-4b8c-99db-69f95ff04b5e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:58.171876 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3ebc39cf-f87e-4b8c-99db-69f95ff04b5e tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1553 microversion: 2.1 time: 0.156178 May 17 22:14:58.172422 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 468/911] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:58 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:14:58.356662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4896ca64-f752-4014-b834-913cba811908 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:58.357356 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4896ca64-f752-4014-b834-913cba811908 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:58.363841 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4896ca64-f752-4014-b834-913cba811908 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:58.364360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4896ca64-f752-4014-b834-913cba811908 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:58.365136 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4896ca64-f752-4014-b834-913cba811908 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:58.365570 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4896ca64-f752-4014-b834-913cba811908 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:58.495072 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4896ca64-f752-4014-b834-913cba811908 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:58.502683 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4896ca64-f752-4014-b834-913cba811908 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1683 microversion: 2.1 time: 0.149856 May 17 22:14:58.503265 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 444/912] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:58 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:14:58.605306 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-946916172", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-925432835", "security_groups": [{"name": "tempest-secgroup-smoke-2049573463"}], "networks": [{"uuid": "f99c992d-0efd-4347-95a8-72386bdb5868"}], "block_device_mapping_v2": [{"uuid": "60a42a5d-4f4e-4518-a43c-ac3ae160be64", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:14:58.718620 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] validate_networks() for [('f99c992d-0efd-4347-95a8-72386bdb5868', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:14:59.176840 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:14:59.177410 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:14:59.178484 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:14:59.179208 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:14:59.179781 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:14:59.189007 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-49d3cb37-6b27-4c8e-9864-359f9d5c45bf tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:59.189861 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-49d3cb37-6b27-4c8e-9864-359f9d5c45bf tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:59.191080 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:59.192550 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:59.193920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:59.194459 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:59.196545 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49d3cb37-6b27-4c8e-9864-359f9d5c45bf tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:59.197073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49d3cb37-6b27-4c8e-9864-359f9d5c45bf tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:59.197968 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49d3cb37-6b27-4c8e-9864-359f9d5c45bf tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:59.198480 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-49d3cb37-6b27-4c8e-9864-359f9d5c45bf tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:59.221838 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Getting quotas for project 74eb5524f74d434b87ff129f9997176b. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:14:59.228418 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Getting quotas for user 692710d8062c42b5a7fabf677bce0598 and project 74eb5524f74d434b87ff129f9997176b. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:14:59.298073 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:14:59.300162 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='60a42a5d-4f4e-4518-a43c-ac3ae160be64',volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:14:59.402429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-49d3cb37-6b27-4c8e-9864-359f9d5c45bf tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:59.411780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-49d3cb37-6b27-4c8e-9864-359f9d5c45bf tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1553 microversion: 2.1 time: 0.227330 May 17 22:14:59.412376 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 445/913] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:59 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:14:59.520478 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d116cd8d-51aa-4baf-877e-b0cf97ad2d69 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:59.521082 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d116cd8d-51aa-4baf-877e-b0cf97ad2d69 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:59.528022 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d116cd8d-51aa-4baf-877e-b0cf97ad2d69 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:59.530046 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d116cd8d-51aa-4baf-877e-b0cf97ad2d69 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:59.530046 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d116cd8d-51aa-4baf-877e-b0cf97ad2d69 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:14:59.530046 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d116cd8d-51aa-4baf-877e-b0cf97ad2d69 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:14:59.803638 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7a70e8e2-cd99-4eec-a4c2-c9f5b9a453e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.202193 May 17 22:14:59.814617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 469/914] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:14:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:14:59.814617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c3538b0f-a943-4c62-b233-409df383e2e2 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:14:59.815245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c3538b0f-a943-4c62-b233-409df383e2e2 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:14:59.930566 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d116cd8d-51aa-4baf-877e-b0cf97ad2d69 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:59.931838 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c3538b0f-a943-4c62-b233-409df383e2e2 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:14:59.940371 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d116cd8d-51aa-4baf-877e-b0cf97ad2d69 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1683 microversion: 2.1 time: 0.423552 May 17 22:14:59.941486 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 446/915] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:59 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1683 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:14:59.958378 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c3538b0f-a943-4c62-b233-409df383e2e2 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1087 microversion: 2.1 time: 0.148036 May 17 22:14:59.959192 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 470/916] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:14:59 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1087 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:00.430531 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6b1638ba-e695-4dcb-b712-2f4f23c9074b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:00.431183 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6b1638ba-e695-4dcb-b712-2f4f23c9074b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:00.438109 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b1638ba-e695-4dcb-b712-2f4f23c9074b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:00.438573 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b1638ba-e695-4dcb-b712-2f4f23c9074b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:00.439383 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b1638ba-e695-4dcb-b712-2f4f23c9074b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:00.439822 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6b1638ba-e695-4dcb-b712-2f4f23c9074b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:00.493822 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-b10d09c5-c319-43c2-a0c4-77f7ba148acf req-45753605-62c6-4ebb-83d9-c450535b3515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c468659-e42a-4284-9a0c-39aa262bd9a5", "name": "network-vif-deleted", "tag": "6b82dab7-02cb-4cc1-a078-91095811826f"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:00.503692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-b10d09c5-c319-43c2-a0c4-77f7ba148acf req-45753605-62c6-4ebb-83d9-c450535b3515 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:00.505469 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-b10d09c5-c319-43c2-a0c4-77f7ba148acf req-45753605-62c6-4ebb-83d9-c450535b3515 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:00.518004 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-b10d09c5-c319-43c2-a0c4-77f7ba148acf req-45753605-62c6-4ebb-83d9-c450535b3515 service nova] Creating event network-vif-deleted:6b82dab7-02cb-4cc1-a078-91095811826f for instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 on hv-cinder-83998 May 17 22:15:00.523126 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6b1638ba-e695-4dcb-b712-2f4f23c9074b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:00.524938 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-b10d09c5-c319-43c2-a0c4-77f7ba148acf req-45753605-62c6-4ebb-83d9-c450535b3515 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036153 May 17 22:15:00.526500 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 471/917] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:00.533981 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6b1638ba-e695-4dcb-b712-2f4f23c9074b tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1511 microversion: 2.1 time: 0.108121 May 17 22:15:00.540002 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 447/918] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:00 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1511 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:00.960276 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-11f7a376-f8de-4bf0-a23f-1d7dc1b90c54 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:00.961365 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-11f7a376-f8de-4bf0-a23f-1d7dc1b90c54 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:00.968669 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11f7a376-f8de-4bf0-a23f-1d7dc1b90c54 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:00.969740 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11f7a376-f8de-4bf0-a23f-1d7dc1b90c54 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:00.970932 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11f7a376-f8de-4bf0-a23f-1d7dc1b90c54 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:00.971669 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11f7a376-f8de-4bf0-a23f-1d7dc1b90c54 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:00.974537 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-731167a3-1aba-460f-ae6f-7a00620442cc tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:00.983643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-731167a3-1aba-460f-ae6f-7a00620442cc tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:01.078450 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-731167a3-1aba-460f-ae6f-7a00620442cc tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:01.080690 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-11f7a376-f8de-4bf0-a23f-1d7dc1b90c54 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:01.085436 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-731167a3-1aba-460f-ae6f-7a00620442cc tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1087 microversion: 2.1 time: 0.114941 May 17 22:15:01.086707 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 448/919] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:00 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1087 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:01.089238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-11f7a376-f8de-4bf0-a23f-1d7dc1b90c54 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1615 microversion: 2.1 time: 0.134688 May 17 22:15:01.089795 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 472/920] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:00 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1615 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:01.552544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fed86e5d-ffc6-4c2f-916a-5da00354ea83 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:01.553172 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-fed86e5d-ffc6-4c2f-916a-5da00354ea83 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:01.560570 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fed86e5d-ffc6-4c2f-916a-5da00354ea83 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:01.561035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fed86e5d-ffc6-4c2f-916a-5da00354ea83 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:01.562079 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fed86e5d-ffc6-4c2f-916a-5da00354ea83 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:01.562509 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fed86e5d-ffc6-4c2f-916a-5da00354ea83 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:01.593496 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fed86e5d-ffc6-4c2f-916a-5da00354ea83 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:01.593941 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-fed86e5d-ffc6-4c2f-916a-5da00354ea83 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:01.594388 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-fed86e5d-ffc6-4c2f-916a-5da00354ea83 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lazy-loading 'fault' on Instance uuid 4c468659-e42a-4284-9a0c-39aa262bd9a5 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:15:01.643938 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-fed86e5d-ffc6-4c2f-916a-5da00354ea83 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1ef9ab26a7442479ec952d43e392081', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b9176d44ed415bacfaf45f3f8472a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:01.652780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fed86e5d-ffc6-4c2f-916a-5da00354ea83 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 200 len: 1346 microversion: 2.1 time: 0.104558 May 17 22:15:01.653447 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 449/921] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:01 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 1346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:02.102852 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-552a6769-f5da-435d-9fbf-e422634743da tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:02.103548 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-552a6769-f5da-435d-9fbf-e422634743da tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:02.105686 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e6432aa7-6d75-4adf-be94-c866ec04d630 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:02.106297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e6432aa7-6d75-4adf-be94-c866ec04d630 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:02.109991 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-552a6769-f5da-435d-9fbf-e422634743da tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:02.110437 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-552a6769-f5da-435d-9fbf-e422634743da tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:02.111237 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-552a6769-f5da-435d-9fbf-e422634743da tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:02.111672 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-552a6769-f5da-435d-9fbf-e422634743da tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:02.112199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e6432aa7-6d75-4adf-be94-c866ec04d630 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:02.112643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e6432aa7-6d75-4adf-be94-c866ec04d630 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:02.114157 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e6432aa7-6d75-4adf-be94-c866ec04d630 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:02.114584 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e6432aa7-6d75-4adf-be94-c866ec04d630 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:02.144889 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e6432aa7-6d75-4adf-be94-c866ec04d630 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:02.145416 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e6432aa7-6d75-4adf-be94-c866ec04d630 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:02.145859 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-e6432aa7-6d75-4adf-be94-c866ec04d630 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lazy-loading 'fault' on Instance uuid af3dd261-a8e5-4aa9-a950-77e2ce94cc45 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:15:02.174938 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-552a6769-f5da-435d-9fbf-e422634743da tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:02.188836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-552a6769-f5da-435d-9fbf-e422634743da tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1185 microversion: 2.1 time: 0.089803 May 17 22:15:02.192445 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 473/922] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:02 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:02.202260 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e6432aa7-6d75-4adf-be94-c866ec04d630 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:02.209689 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e6432aa7-6d75-4adf-be94-c866ec04d630 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 200 len: 1331 microversion: 2.1 time: 0.107882 May 17 22:15:02.210257 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 450/923] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:02 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:15:02.566159 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-6513c118-6840-4b4b-abf9-4f5f03f57747 req-50c6286e-fbf0-4bdc-aaf8-ea23f0db5396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af3dd261-a8e5-4aa9-a950-77e2ce94cc45", "name": "network-vif-deleted", "tag": "d038f455-52e9-4943-8fef-3e82a226e892"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:02.578530 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-6513c118-6840-4b4b-abf9-4f5f03f57747 req-50c6286e-fbf0-4bdc-aaf8-ea23f0db5396 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:02.578998 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-6513c118-6840-4b4b-abf9-4f5f03f57747 req-50c6286e-fbf0-4bdc-aaf8-ea23f0db5396 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:02.593926 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-6513c118-6840-4b4b-abf9-4f5f03f57747 req-50c6286e-fbf0-4bdc-aaf8-ea23f0db5396 service nova] Creating event network-vif-deleted:d038f455-52e9-4943-8fef-3e82a226e892 for instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 on hv-cinder-83998 May 17 22:15:02.600931 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-6513c118-6840-4b4b-abf9-4f5f03f57747 req-50c6286e-fbf0-4bdc-aaf8-ea23f0db5396 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037489 May 17 22:15:02.601039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 474/924] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:02.670037 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8bbbd6e7-6443-403f-b0ed-1469f1bc0df0 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:02.670639 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8bbbd6e7-6443-403f-b0ed-1469f1bc0df0 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] [instance: 4c468659-e42a-4284-9a0c-39aa262bd9a5] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:02.677694 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8bbbd6e7-6443-403f-b0ed-1469f1bc0df0 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:02.678469 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8bbbd6e7-6443-403f-b0ed-1469f1bc0df0 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:02.679286 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8bbbd6e7-6443-403f-b0ed-1469f1bc0df0 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:02.679896 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8bbbd6e7-6443-403f-b0ed-1469f1bc0df0 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:02.695994 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-8bbbd6e7-6443-403f-b0ed-1469f1bc0df0 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] HTTP exception thrown: Instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 could not be found. May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8bbbd6e7-6443-403f-b0ed-1469f1bc0df0 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Request method failure captured: May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 HTTP/1.1 May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB1stDdAI6PgNtstrhkXlcMLzlj5FIzSDa3t56k4hnLcBAyI2bWrSSubA6dKEhYVwblT6efJuowjX5oFJkGCcBgWUCHIpWe8jTaf8XC3m5ZM4_MObVQcCf9eALB5k3Iq7EwbGCTH3v4BOZ8Jyf5rJ6Dh_8BZI2cOS24dwprm7lpODEU May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: f3b9176d44ed415bacfaf45f3f8472a5 May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-TestMinimumBasicScenario-1587986245 May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:15:02.697653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:15:02.699539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f3b9176d44ed415bacfaf45f3f8472a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f3b9176d44ed415bacfaf45f3f8472a5", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f3b9176d44ed415bacfaf45f3f8472a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f3b9176d44ed415bacfaf45f3f8472a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:15:02.699539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-TestMinimumBasicScenario-1587986245 May 17 22:15:02.699539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: f3b9176d44ed415bacfaf45f3f8472a5 May 17 22:15:02.699539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1587986245 May 17 22:15:02.699539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-TestMinimumBasicScenario-1587986245-project May 17 22:15:02.699539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:15:02.699539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:15:02.699539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: b1ef9ab26a7442479ec952d43e392081 May 17 22:15:02.699539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-TestMinimumBasicScenario-1587986245-project May 17 22:15:02.699539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:15:02.699539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 could not be found. May 17 22:15:02.699539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '4c468659-e42a-4284-9a0c-39aa262bd9a5'} May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 could not be found. May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:15:02.700678 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 could not be found. May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 could not be found. May 17 22:15:02.702967 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:15:02.704297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8bbbd6e7-6443-403f-b0ed-1469f1bc0df0 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Returning 404 to user: Instance 4c468659-e42a-4284-9a0c-39aa262bd9a5 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:15:02.704297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8bbbd6e7-6443-403f-b0ed-1469f1bc0df0 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5" status: 404 len: 111 microversion: 2.1 time: 0.033001 May 17 22:15:02.704297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 451/925] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:02 2022] GET /compute/v2.1/servers/4c468659-e42a-4284-9a0c-39aa262bd9a5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:15:02.708577 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0431ff09-590b-4946-a3a3-d7126e242559 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] Calling method '.version_select at 0x7f09f20e3af0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:02.812130 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0431ff09-590b-4946-a3a3-d7126e242559 tempest-TestMinimumBasicScenario-1587986245 tempest-TestMinimumBasicScenario-1587986245-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-208810577" status: 202 len: 0 microversion: 2.1 time: 0.107585 May 17 22:15:02.812718 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 475/926] 10.222.0.24 () {58 vars in 1268 bytes} [Tue May 17 22:15:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-208810577 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:15:03.206323 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e051bf07-2910-4682-aedb-7482cd114be1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:03.207828 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e051bf07-2910-4682-aedb-7482cd114be1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:03.214172 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e051bf07-2910-4682-aedb-7482cd114be1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:03.214702 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e051bf07-2910-4682-aedb-7482cd114be1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:03.215568 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e051bf07-2910-4682-aedb-7482cd114be1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:03.216249 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e051bf07-2910-4682-aedb-7482cd114be1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:03.230178 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9d51fca3-2134-4d8f-bb6a-8ea5d2c5a7c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:03.230842 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9d51fca3-2134-4d8f-bb6a-8ea5d2c5a7c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:03.238074 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d51fca3-2134-4d8f-bb6a-8ea5d2c5a7c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:03.238674 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d51fca3-2134-4d8f-bb6a-8ea5d2c5a7c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:03.239500 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d51fca3-2134-4d8f-bb6a-8ea5d2c5a7c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:03.239937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9d51fca3-2134-4d8f-bb6a-8ea5d2c5a7c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:03.257822 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-9d51fca3-2134-4d8f-bb6a-8ea5d2c5a7c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9d51fca3-2134-4d8f-bb6a-8ea5d2c5a7c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 HTTP/1.1 May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:15:03.259744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:15:03.261138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:15:03.261138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:15:03.261138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:15:03.261138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:15:03.261138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:15:03.261138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:15:03.261138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:15:03.261138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:15:03.261138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:15:03.261138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:15:03.261138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:15:03.261138 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': 'af3dd261-a8e5-4aa9-a950-77e2ce94cc45'} May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:15:03.261889 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:15:03.264089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:15:03.266048 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9d51fca3-2134-4d8f-bb6a-8ea5d2c5a7c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 404 to user: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:15:03.266048 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9d51fca3-2134-4d8f-bb6a-8ea5d2c5a7c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 404 len: 111 microversion: 2.1 time: 0.035373 May 17 22:15:03.266048 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 476/927] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:03 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 22:15:03.272251 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2e83820f-1fac-48e7-9d6f-07ea385b544b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '.version_select at 0x7f09f21338b0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:03.297031 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e051bf07-2910-4682-aedb-7482cd114be1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:03.304543 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e051bf07-2910-4682-aedb-7482cd114be1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1203 microversion: 2.1 time: 0.102537 May 17 22:15:03.313012 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 452/928] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:03 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1203 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:03.380750 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2e83820f-1fac-48e7-9d6f-07ea385b544b tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218001136" status: 202 len: 0 microversion: 2.1 time: 0.112920 May 17 22:15:03.381249 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 477/929] 10.222.0.24 () {58 vars in 1217 bytes} [Tue May 17 22:15:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218001136 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:15:04.323084 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8d8a130d-e52f-4fc2-8dbe-400864f94b1b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:04.324933 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8d8a130d-e52f-4fc2-8dbe-400864f94b1b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:04.332872 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d8a130d-e52f-4fc2-8dbe-400864f94b1b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:04.333318 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d8a130d-e52f-4fc2-8dbe-400864f94b1b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:04.334095 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d8a130d-e52f-4fc2-8dbe-400864f94b1b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:04.334525 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8d8a130d-e52f-4fc2-8dbe-400864f94b1b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:04.652014 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8d8a130d-e52f-4fc2-8dbe-400864f94b1b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:04.659954 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8d8a130d-e52f-4fc2-8dbe-400864f94b1b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1271 microversion: 2.1 time: 0.341855 May 17 22:15:04.667133 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 453/930] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:04 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1271 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:04.997993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-824488fa-0b8e-4252-adf2-5ec3e03cf20e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: .version_select at 0x7f09f20a2e50>, body: {"keypair": {"name": "tempest-keypair-1538369640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKECMNGqoP5KYBh8KsfNh8WmeeXCgM/AV8bHoOoftflUsOBtGRH/CZ3NBTg0g73jaPLqIftl2vjWkIQ5ihCWHyopQPsAh8chJHfCo1NbThiikU+glFrdBOVR92zMNR6fw=="}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:05.019408 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-824488fa-0b8e-4252-adf2-5ec3e03cf20e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for project ea0809b61be446a69359b69b50b61710. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:15:05.024304 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-824488fa-0b8e-4252-adf2-5ec3e03cf20e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for user 4bbb6a0a08464e738ef0d062dfe87182 and project ea0809b61be446a69359b69b50b61710. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:15:05.140038 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-824488fa-0b8e-4252-adf2-5ec3e03cf20e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.148094 May 17 22:15:05.141305 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 478/931] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 17 22:15:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:05.579498 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-790d99a6-bdb5-4c41-a52c-64f58c529780 req-def4e7d6-c49e-45e1-ba56-a0cc8e45b133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11fe4fe4-16e9-4a9d-a0cf-954d520222c2", "tag": "9c8d665a-b5a0-45a4-a0ba-7f36817e2db3"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:05.589085 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-790d99a6-bdb5-4c41-a52c-64f58c529780 req-def4e7d6-c49e-45e1-ba56-a0cc8e45b133 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:05.590163 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-790d99a6-bdb5-4c41-a52c-64f58c529780 req-def4e7d6-c49e-45e1-ba56-a0cc8e45b133 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:05.616840 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-790d99a6-bdb5-4c41-a52c-64f58c529780 req-def4e7d6-c49e-45e1-ba56-a0cc8e45b133 service nova] Creating event network-changed:9c8d665a-b5a0-45a4-a0ba-7f36817e2db3 for instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 on hv-cinder-83998 May 17 22:15:05.631330 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-790d99a6-bdb5-4c41-a52c-64f58c529780 req-def4e7d6-c49e-45e1-ba56-a0cc8e45b133 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051366 May 17 22:15:05.631330 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 454/932] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:05.678078 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a2f0dcac-e58f-49f4-bfc6-62876084efa7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:05.678759 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a2f0dcac-e58f-49f4-bfc6-62876084efa7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:05.684962 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2f0dcac-e58f-49f4-bfc6-62876084efa7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:05.685404 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2f0dcac-e58f-49f4-bfc6-62876084efa7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:05.686348 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2f0dcac-e58f-49f4-bfc6-62876084efa7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:05.687417 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2f0dcac-e58f-49f4-bfc6-62876084efa7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:05.908266 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a2f0dcac-e58f-49f4-bfc6-62876084efa7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:05.915941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a2f0dcac-e58f-49f4-bfc6-62876084efa7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1259 microversion: 2.1 time: 0.243681 May 17 22:15:05.916513 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 479/933] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:05 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1259 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:06.944615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-24697e19-3672-4ce4-bc00-5ae7d061042f tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:06.945441 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-24697e19-3672-4ce4-bc00-5ae7d061042f tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:06.951745 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-24697e19-3672-4ce4-bc00-5ae7d061042f tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:06.952189 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-24697e19-3672-4ce4-bc00-5ae7d061042f tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:06.952963 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-24697e19-3672-4ce4-bc00-5ae7d061042f tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:06.953390 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-24697e19-3672-4ce4-bc00-5ae7d061042f tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:07.107020 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-24697e19-3672-4ce4-bc00-5ae7d061042f tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:07.116157 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-24697e19-3672-4ce4-bc00-5ae7d061042f tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1259 microversion: 2.1 time: 0.182230 May 17 22:15:07.116774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 455/934] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:06 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:08.141039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a2f8a1a6-94e2-4a40-b945-e979583ca5ef tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:08.141684 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a2f8a1a6-94e2-4a40-b945-e979583ca5ef tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:08.148617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2f8a1a6-94e2-4a40-b945-e979583ca5ef tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:08.149069 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2f8a1a6-94e2-4a40-b945-e979583ca5ef tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:08.150087 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2f8a1a6-94e2-4a40-b945-e979583ca5ef tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:08.150627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a2f8a1a6-94e2-4a40-b945-e979583ca5ef tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:08.517719 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a2f8a1a6-94e2-4a40-b945-e979583ca5ef tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:08.527092 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a2f8a1a6-94e2-4a40-b945-e979583ca5ef tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1259 microversion: 2.1 time: 0.391554 May 17 22:15:08.527857 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 480/935] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:08 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1259 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:08.804714 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-321011139", "imageRef": "a7f6afee-a9f8-492e-91fc-66784abb6649", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f877e2b-99bd-48e8-8b73-18e37441b914"}], "security_groups": [{"name": "tempest-securitygroup--869462030"}], "key_name": "tempest-keypair-1538369640", "user_data": "}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:08.908899 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] validate_networks() for [('6f877e2b-99bd-48e8-8b73-18e37441b914', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:15:09.337017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:15:09.337238 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:15:09.337917 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:15:09.338321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:15:09.338730 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:15:09.348604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:09.349053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:09.349834 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:09.350262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:09.367181 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for project ea0809b61be446a69359b69b50b61710. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:15:09.372841 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Getting quotas for user 4bbb6a0a08464e738ef0d062dfe87182 and project ea0809b61be446a69359b69b50b61710. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:15:09.382594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:15:09.385120 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7f6afee-a9f8-492e-91fc-66784abb6649',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:15:09.552390 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8bdbada0-0144-4878-aa47-0f942ce090f7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:09.553010 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8bdbada0-0144-4878-aa47-0f942ce090f7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:09.559736 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8bdbada0-0144-4878-aa47-0f942ce090f7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:09.560192 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8bdbada0-0144-4878-aa47-0f942ce090f7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:09.560977 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8bdbada0-0144-4878-aa47-0f942ce090f7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:09.561411 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8bdbada0-0144-4878-aa47-0f942ce090f7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:09.582319 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1f01fd94-2d60-4095-b633-790de7bd5c04 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.781709 May 17 22:15:09.583266 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 456/936] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:15:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:15:09.601514 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e18d0049-ca7d-4024-9dc8-1108a5eb64c4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:09.602478 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e18d0049-ca7d-4024-9dc8-1108a5eb64c4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:09.715074 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e18d0049-ca7d-4024-9dc8-1108a5eb64c4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:09.733180 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e18d0049-ca7d-4024-9dc8-1108a5eb64c4 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1241 microversion: 2.1 time: 0.137226 May 17 22:15:09.734880 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 457/937] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:09 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:09.746466 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8bdbada0-0144-4878-aa47-0f942ce090f7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:09.755047 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8bdbada0-0144-4878-aa47-0f942ce090f7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1259 microversion: 2.1 time: 0.207000 May 17 22:15:09.755581 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 481/938] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:09 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:10.751176 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ad5f8947-dfae-4da9-9a6b-7d3864a0d5c9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:10.751800 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ad5f8947-dfae-4da9-9a6b-7d3864a0d5c9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:10.758924 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ad5f8947-dfae-4da9-9a6b-7d3864a0d5c9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:10.760119 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ad5f8947-dfae-4da9-9a6b-7d3864a0d5c9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:10.761264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ad5f8947-dfae-4da9-9a6b-7d3864a0d5c9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:10.761775 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ad5f8947-dfae-4da9-9a6b-7d3864a0d5c9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:10.772545 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-76f213b5-58ae-4dcf-be3a-7f4f319110b8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:10.773167 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-76f213b5-58ae-4dcf-be3a-7f4f319110b8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:10.779801 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76f213b5-58ae-4dcf-be3a-7f4f319110b8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:10.780578 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76f213b5-58ae-4dcf-be3a-7f4f319110b8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:10.781611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76f213b5-58ae-4dcf-be3a-7f4f319110b8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:10.782264 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-76f213b5-58ae-4dcf-be3a-7f4f319110b8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:10.889286 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ad5f8947-dfae-4da9-9a6b-7d3864a0d5c9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:10.901964 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ad5f8947-dfae-4da9-9a6b-7d3864a0d5c9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1245 microversion: 2.1 time: 0.154612 May 17 22:15:10.913797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 458/939] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:10 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1245 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:11.115034 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-76f213b5-58ae-4dcf-be3a-7f4f319110b8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:11.133362 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-76f213b5-58ae-4dcf-be3a-7f4f319110b8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1259 microversion: 2.1 time: 0.365127 May 17 22:15:11.134301 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 482/940] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:10 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1259 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:15:11.920873 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c818e828-eb4f-4180-b8a3-fb512fbbad8f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:11.926544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c818e828-eb4f-4180-b8a3-fb512fbbad8f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:11.930198 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c818e828-eb4f-4180-b8a3-fb512fbbad8f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:11.930896 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c818e828-eb4f-4180-b8a3-fb512fbbad8f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:11.931700 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c818e828-eb4f-4180-b8a3-fb512fbbad8f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:11.932137 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c818e828-eb4f-4180-b8a3-fb512fbbad8f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:12.000212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c818e828-eb4f-4180-b8a3-fb512fbbad8f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:12.011437 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c818e828-eb4f-4180-b8a3-fb512fbbad8f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1293 microversion: 2.1 time: 0.095687 May 17 22:15:12.012489 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 459/941] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:11 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:12.150595 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3bab806c-7032-4fa0-b2a9-5ae3794f18b1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:12.151928 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3bab806c-7032-4fa0-b2a9-5ae3794f18b1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:12.159887 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bab806c-7032-4fa0-b2a9-5ae3794f18b1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:12.160503 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bab806c-7032-4fa0-b2a9-5ae3794f18b1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:12.161331 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bab806c-7032-4fa0-b2a9-5ae3794f18b1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:12.161767 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bab806c-7032-4fa0-b2a9-5ae3794f18b1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:12.375160 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3bab806c-7032-4fa0-b2a9-5ae3794f18b1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:12.405190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3bab806c-7032-4fa0-b2a9-5ae3794f18b1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1259 microversion: 2.1 time: 0.239582 May 17 22:15:12.405190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 483/942] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:12 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:13.030111 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-98fe7276-2c72-43f5-a76b-38edd403f25d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:13.031338 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-98fe7276-2c72-43f5-a76b-38edd403f25d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:13.038060 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-98fe7276-2c72-43f5-a76b-38edd403f25d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:13.038643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-98fe7276-2c72-43f5-a76b-38edd403f25d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:13.039442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-98fe7276-2c72-43f5-a76b-38edd403f25d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:13.040091 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-98fe7276-2c72-43f5-a76b-38edd403f25d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:13.299872 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-98fe7276-2c72-43f5-a76b-38edd403f25d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:13.310836 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-98fe7276-2c72-43f5-a76b-38edd403f25d tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1366 microversion: 2.1 time: 0.283983 May 17 22:15:13.322283 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 460/943] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:13 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:13.403368 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dfc52d3a-6671-41f2-a9b6-da82f78fa332 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:13.403974 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-dfc52d3a-6671-41f2-a9b6-da82f78fa332 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:13.410998 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dfc52d3a-6671-41f2-a9b6-da82f78fa332 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:13.411482 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dfc52d3a-6671-41f2-a9b6-da82f78fa332 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:13.412268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dfc52d3a-6671-41f2-a9b6-da82f78fa332 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:13.412704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-dfc52d3a-6671-41f2-a9b6-da82f78fa332 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:13.650551 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-dfc52d3a-6671-41f2-a9b6-da82f78fa332 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:13.658345 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dfc52d3a-6671-41f2-a9b6-da82f78fa332 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1259 microversion: 2.1 time: 0.258919 May 17 22:15:13.658903 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 484/944] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:13 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:14.329377 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4d33779b-1e92-427c-8489-89228e9352b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:14.330591 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4d33779b-1e92-427c-8489-89228e9352b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:14.339925 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d33779b-1e92-427c-8489-89228e9352b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:14.340290 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d33779b-1e92-427c-8489-89228e9352b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:14.341070 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d33779b-1e92-427c-8489-89228e9352b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:14.341501 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4d33779b-1e92-427c-8489-89228e9352b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:14.356920 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-dddf6a02-9dc9-4939-b90d-5eb0343e1253 req-446eb28a-483a-41a8-bc7f-96003a9155c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fa9042-8c2f-46bd-8570-97f8e8585216", "tag": "d95aec15-6d35-4b78-ab7f-a8a90baf08e7"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:14.370538 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-dddf6a02-9dc9-4939-b90d-5eb0343e1253 req-446eb28a-483a-41a8-bc7f-96003a9155c0 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:14.370538 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-dddf6a02-9dc9-4939-b90d-5eb0343e1253 req-446eb28a-483a-41a8-bc7f-96003a9155c0 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:14.385585 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-dddf6a02-9dc9-4939-b90d-5eb0343e1253 req-446eb28a-483a-41a8-bc7f-96003a9155c0 service nova] Creating event network-changed:d95aec15-6d35-4b78-ab7f-a8a90baf08e7 for instance f3fa9042-8c2f-46bd-8570-97f8e8585216 on hv-cinder-83998 May 17 22:15:14.398627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-dddf6a02-9dc9-4939-b90d-5eb0343e1253 req-446eb28a-483a-41a8-bc7f-96003a9155c0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047541 May 17 22:15:14.399391 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 485/945] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:14.512845 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4d33779b-1e92-427c-8489-89228e9352b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:14.521189 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4d33779b-1e92-427c-8489-89228e9352b7 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1366 microversion: 2.1 time: 0.195549 May 17 22:15:14.521788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 461/946] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:14 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:14.676826 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-04047cf0-7467-4efa-85b5-d638cb45258e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:14.677525 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-04047cf0-7467-4efa-85b5-d638cb45258e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:14.683658 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-04047cf0-7467-4efa-85b5-d638cb45258e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:14.684114 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-04047cf0-7467-4efa-85b5-d638cb45258e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:14.684891 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-04047cf0-7467-4efa-85b5-d638cb45258e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:14.685330 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-04047cf0-7467-4efa-85b5-d638cb45258e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:14.915899 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-04047cf0-7467-4efa-85b5-d638cb45258e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:14.923254 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-04047cf0-7467-4efa-85b5-d638cb45258e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1259 microversion: 2.1 time: 0.251752 May 17 22:15:14.923825 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 486/947] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:14 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:15.538058 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ef9b594c-bd6b-439c-9ef3-830a8817a17e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:15.538674 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ef9b594c-bd6b-439c-9ef3-830a8817a17e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:15.545065 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ef9b594c-bd6b-439c-9ef3-830a8817a17e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:15.546352 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ef9b594c-bd6b-439c-9ef3-830a8817a17e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:15.546352 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ef9b594c-bd6b-439c-9ef3-830a8817a17e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:15.546711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ef9b594c-bd6b-439c-9ef3-830a8817a17e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:15.770489 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ef9b594c-bd6b-439c-9ef3-830a8817a17e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:15.778489 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ef9b594c-bd6b-439c-9ef3-830a8817a17e tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1366 microversion: 2.1 time: 0.244434 May 17 22:15:15.779353 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 462/948] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:15 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:15.944033 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8b897434-c5a3-4651-b6ca-bee6c92a48af tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:15.944726 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8b897434-c5a3-4651-b6ca-bee6c92a48af tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:15.951848 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8b897434-c5a3-4651-b6ca-bee6c92a48af tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:15.952531 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8b897434-c5a3-4651-b6ca-bee6c92a48af tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:15.953462 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8b897434-c5a3-4651-b6ca-bee6c92a48af tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:15.954061 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8b897434-c5a3-4651-b6ca-bee6c92a48af tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:16.097898 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8b897434-c5a3-4651-b6ca-bee6c92a48af tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:16.106604 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8b897434-c5a3-4651-b6ca-bee6c92a48af tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1259 microversion: 2.1 time: 0.167694 May 17 22:15:16.107510 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 487/949] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:15 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:16.796227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f37f7927-ea19-4404-b100-09a3d26bd5be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:16.796848 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f37f7927-ea19-4404-b100-09a3d26bd5be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:16.803178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f37f7927-ea19-4404-b100-09a3d26bd5be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:16.803629 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f37f7927-ea19-4404-b100-09a3d26bd5be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:16.804395 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f37f7927-ea19-4404-b100-09a3d26bd5be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:16.804848 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f37f7927-ea19-4404-b100-09a3d26bd5be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:16.931558 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f37f7927-ea19-4404-b100-09a3d26bd5be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:16.939159 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f37f7927-ea19-4404-b100-09a3d26bd5be tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1366 microversion: 2.1 time: 0.146749 May 17 22:15:16.939924 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 463/950] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:16 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:17.123861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f19132b7-2b73-44c3-b675-f7258706ea3e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:17.124648 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f19132b7-2b73-44c3-b675-f7258706ea3e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:17.132401 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f19132b7-2b73-44c3-b675-f7258706ea3e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:17.132947 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f19132b7-2b73-44c3-b675-f7258706ea3e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:17.133706 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f19132b7-2b73-44c3-b675-f7258706ea3e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:17.134133 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f19132b7-2b73-44c3-b675-f7258706ea3e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:17.271586 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f19132b7-2b73-44c3-b675-f7258706ea3e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:17.278904 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f19132b7-2b73-44c3-b675-f7258706ea3e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1259 microversion: 2.1 time: 0.158974 May 17 22:15:17.279702 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 488/951] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:17 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:17.956667 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f99a0530-3c84-4413-b764-175838019e6a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:17.957288 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f99a0530-3c84-4413-b764-175838019e6a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:17.963794 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f99a0530-3c84-4413-b764-175838019e6a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:17.964288 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f99a0530-3c84-4413-b764-175838019e6a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:17.965077 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f99a0530-3c84-4413-b764-175838019e6a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:17.965519 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f99a0530-3c84-4413-b764-175838019e6a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:18.110390 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f99a0530-3c84-4413-b764-175838019e6a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:18.112607 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-dc9159e1-571c-4cf3-86db-d6e14480d38d req-9e5c1ec3-1c67-4992-9c8b-823905a1e435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fe4fe4-16e9-4a9d-a0cf-954d520222c2", "name": "network-vif-plugged", "status": "completed", "tag": "9c8d665a-b5a0-45a4-a0ba-7f36817e2db3"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:18.123092 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f99a0530-3c84-4413-b764-175838019e6a tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1366 microversion: 2.1 time: 0.170110 May 17 22:15:18.123835 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-dc9159e1-571c-4cf3-86db-d6e14480d38d req-9e5c1ec3-1c67-4992-9c8b-823905a1e435 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:18.123988 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 464/952] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:17 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:18.124853 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-dc9159e1-571c-4cf3-86db-d6e14480d38d req-9e5c1ec3-1c67-4992-9c8b-823905a1e435 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:18.137408 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-dc9159e1-571c-4cf3-86db-d6e14480d38d req-9e5c1ec3-1c67-4992-9c8b-823905a1e435 service nova] Creating event network-vif-plugged:9c8d665a-b5a0-45a4-a0ba-7f36817e2db3 for instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 on hv-cinder-83998 May 17 22:15:18.142552 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-dc9159e1-571c-4cf3-86db-d6e14480d38d req-9e5c1ec3-1c67-4992-9c8b-823905a1e435 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159482 May 17 22:15:18.143306 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 489/953] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:15:18.295897 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-26f4f25a-9139-47f1-bf2e-14af75599cfd tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:18.296510 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-26f4f25a-9139-47f1-bf2e-14af75599cfd tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:18.303027 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-26f4f25a-9139-47f1-bf2e-14af75599cfd tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:18.303518 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-26f4f25a-9139-47f1-bf2e-14af75599cfd tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:18.304300 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-26f4f25a-9139-47f1-bf2e-14af75599cfd tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:18.304770 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-26f4f25a-9139-47f1-bf2e-14af75599cfd tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:18.444887 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-26f4f25a-9139-47f1-bf2e-14af75599cfd tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:18.450469 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-26f4f25a-9139-47f1-bf2e-14af75599cfd tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1259 microversion: 2.1 time: 0.158551 May 17 22:15:18.451055 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 465/954] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:18 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:19.143322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-adacf804-39f5-4af5-bbf0-3135df05c8e5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:19.144823 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-adacf804-39f5-4af5-bbf0-3135df05c8e5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:19.151595 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-adacf804-39f5-4af5-bbf0-3135df05c8e5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:19.152042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-adacf804-39f5-4af5-bbf0-3135df05c8e5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:19.152818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-adacf804-39f5-4af5-bbf0-3135df05c8e5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:19.153236 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-adacf804-39f5-4af5-bbf0-3135df05c8e5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:19.290648 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-adacf804-39f5-4af5-bbf0-3135df05c8e5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:19.297928 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-adacf804-39f5-4af5-bbf0-3135df05c8e5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1366 microversion: 2.1 time: 0.159282 May 17 22:15:19.298523 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 490/955] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:19 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:19.467696 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-16e8def7-fcfe-4689-bfd7-6d4c319a8a76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:19.468402 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-16e8def7-fcfe-4689-bfd7-6d4c319a8a76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:19.474789 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-16e8def7-fcfe-4689-bfd7-6d4c319a8a76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:19.475287 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-16e8def7-fcfe-4689-bfd7-6d4c319a8a76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:19.476039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-16e8def7-fcfe-4689-bfd7-6d4c319a8a76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:19.476477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-16e8def7-fcfe-4689-bfd7-6d4c319a8a76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:19.613243 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-16e8def7-fcfe-4689-bfd7-6d4c319a8a76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:19.618337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-16e8def7-fcfe-4689-bfd7-6d4c319a8a76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1259 microversion: 2.1 time: 0.154450 May 17 22:15:19.618906 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 466/956] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:19 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:20.163604 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-6edd13fb-a1c9-4599-b372-49c7fbbc0f34 req-cd180872-d025-4009-863a-c28166c3fc3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fa9042-8c2f-46bd-8570-97f8e8585216", "name": "network-vif-plugged", "status": "completed", "tag": "d95aec15-6d35-4b78-ab7f-a8a90baf08e7"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:20.172085 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-6edd13fb-a1c9-4599-b372-49c7fbbc0f34 req-cd180872-d025-4009-863a-c28166c3fc3d service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:20.175897 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-6edd13fb-a1c9-4599-b372-49c7fbbc0f34 req-cd180872-d025-4009-863a-c28166c3fc3d service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:20.184009 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-6edd13fb-a1c9-4599-b372-49c7fbbc0f34 req-cd180872-d025-4009-863a-c28166c3fc3d service nova] Creating event network-vif-plugged:d95aec15-6d35-4b78-ab7f-a8a90baf08e7 for instance f3fa9042-8c2f-46bd-8570-97f8e8585216 on hv-cinder-83998 May 17 22:15:20.189115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-6edd13fb-a1c9-4599-b372-49c7fbbc0f34 req-cd180872-d025-4009-863a-c28166c3fc3d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029105 May 17 22:15:20.189730 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 491/957] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:20.315498 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6320d87d-45eb-4e5f-9fb2-f8bd6fa5a07c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:20.316931 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6320d87d-45eb-4e5f-9fb2-f8bd6fa5a07c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:20.322846 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6320d87d-45eb-4e5f-9fb2-f8bd6fa5a07c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:20.323334 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6320d87d-45eb-4e5f-9fb2-f8bd6fa5a07c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:20.324152 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6320d87d-45eb-4e5f-9fb2-f8bd6fa5a07c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:20.324582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6320d87d-45eb-4e5f-9fb2-f8bd6fa5a07c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:20.456039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6320d87d-45eb-4e5f-9fb2-f8bd6fa5a07c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:20.463323 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6320d87d-45eb-4e5f-9fb2-f8bd6fa5a07c tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1366 microversion: 2.1 time: 0.152055 May 17 22:15:20.463894 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 467/958] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:20 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:20.636643 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3f1dfa0a-83e4-45aa-b927-e45a542dc0a2 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:20.637339 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3f1dfa0a-83e4-45aa-b927-e45a542dc0a2 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:20.643789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3f1dfa0a-83e4-45aa-b927-e45a542dc0a2 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:20.644440 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3f1dfa0a-83e4-45aa-b927-e45a542dc0a2 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:20.645227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3f1dfa0a-83e4-45aa-b927-e45a542dc0a2 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:20.645672 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3f1dfa0a-83e4-45aa-b927-e45a542dc0a2 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:20.788165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3f1dfa0a-83e4-45aa-b927-e45a542dc0a2 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:20.796248 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3f1dfa0a-83e4-45aa-b927-e45a542dc0a2 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1442 microversion: 2.1 time: 0.163713 May 17 22:15:20.796810 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 492/959] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:20 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:20.814457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-39b819c4-ddc5-4625-abc6-e140056b1ecf tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:20.815059 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-39b819c4-ddc5-4625-abc6-e140056b1ecf tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:20.821461 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39b819c4-ddc5-4625-abc6-e140056b1ecf tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:20.821899 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39b819c4-ddc5-4625-abc6-e140056b1ecf tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:20.822871 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39b819c4-ddc5-4625-abc6-e140056b1ecf tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:20.823326 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-39b819c4-ddc5-4625-abc6-e140056b1ecf tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:20.842195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-574bfc4a-250f-48c4-a42a-2281b145d075 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:20.842813 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-574bfc4a-250f-48c4-a42a-2281b145d075 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:20.849693 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-574bfc4a-250f-48c4-a42a-2281b145d075 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:20.850146 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-574bfc4a-250f-48c4-a42a-2281b145d075 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:20.850916 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-574bfc4a-250f-48c4-a42a-2281b145d075 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:20.851380 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-574bfc4a-250f-48c4-a42a-2281b145d075 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:20.876372 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-574bfc4a-250f-48c4-a42a-2281b145d075 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/ips" status: 200 len: 146 microversion: 2.1 time: 0.037905 May 17 22:15:20.877845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 493/960] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 17 22:15:20 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:15:20.890212 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1851a459-281f-4922-abaf-8c354b3be05a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:20.890718 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1851a459-281f-4922-abaf-8c354b3be05a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:20.897456 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1851a459-281f-4922-abaf-8c354b3be05a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:20.897915 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1851a459-281f-4922-abaf-8c354b3be05a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:20.898697 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1851a459-281f-4922-abaf-8c354b3be05a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:20.899144 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1851a459-281f-4922-abaf-8c354b3be05a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:20.924003 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1851a459-281f-4922-abaf-8c354b3be05a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/ips" status: 200 len: 149 microversion: 2.20 time: 0.038868 May 17 22:15:20.929855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 494/961] 10.222.0.24 () {60 vars in 1288 bytes} [Tue May 17 22:15:20 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 22:15:20.970139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-39b819c4-ddc5-4625-abc6-e140056b1ecf tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:20.978517 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-39b819c4-ddc5-4625-abc6-e140056b1ecf tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1442 microversion: 2.1 time: 0.168059 May 17 22:15:20.979452 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 468/962] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:20 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1442 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:15:21.480900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9b12c61e-15c9-4ff3-b0b2-f142afc12629 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:21.481515 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9b12c61e-15c9-4ff3-b0b2-f142afc12629 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:21.487926 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b12c61e-15c9-4ff3-b0b2-f142afc12629 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:21.490776 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b12c61e-15c9-4ff3-b0b2-f142afc12629 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:21.490776 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b12c61e-15c9-4ff3-b0b2-f142afc12629 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:21.490776 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9b12c61e-15c9-4ff3-b0b2-f142afc12629 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:21.751281 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9b12c61e-15c9-4ff3-b0b2-f142afc12629 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:21.776681 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9b12c61e-15c9-4ff3-b0b2-f142afc12629 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1366 microversion: 2.1 time: 0.299885 May 17 22:15:21.783823 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 495/963] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:21 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:22.800171 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0c5619a1-edfb-482e-a2bd-de894bdbeae9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:22.800778 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0c5619a1-edfb-482e-a2bd-de894bdbeae9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:22.807434 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0c5619a1-edfb-482e-a2bd-de894bdbeae9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:22.807877 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0c5619a1-edfb-482e-a2bd-de894bdbeae9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:22.808634 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0c5619a1-edfb-482e-a2bd-de894bdbeae9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:22.809057 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0c5619a1-edfb-482e-a2bd-de894bdbeae9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:22.921774 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fd924bca-5296-4c61-910a-b3e6cee042b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e39c7aff-d027-4689-942b-458e5a4c94b6"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:22.922941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fd924bca-5296-4c61-910a-b3e6cee042b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:22.929550 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd924bca-5296-4c61-910a-b3e6cee042b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:22.932289 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd924bca-5296-4c61-910a-b3e6cee042b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:22.932289 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd924bca-5296-4c61-910a-b3e6cee042b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:22.932289 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd924bca-5296-4c61-910a-b3e6cee042b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:23.062580 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0c5619a1-edfb-482e-a2bd-de894bdbeae9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:23.070436 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0c5619a1-edfb-482e-a2bd-de894bdbeae9 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1556 microversion: 2.1 time: 0.274211 May 17 22:15:23.071209 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 469/964] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:22 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1556 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:23.087503 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ca7617dc-2091-4e09-b3fd-5e94076cc965 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:23.088142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ca7617dc-2091-4e09-b3fd-5e94076cc965 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:23.094019 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca7617dc-2091-4e09-b3fd-5e94076cc965 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:23.094471 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca7617dc-2091-4e09-b3fd-5e94076cc965 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:23.095274 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca7617dc-2091-4e09-b3fd-5e94076cc965 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:23.095710 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ca7617dc-2091-4e09-b3fd-5e94076cc965 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:23.220287 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ca7617dc-2091-4e09-b3fd-5e94076cc965 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136545 May 17 22:15:23.220889 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 470/965] 10.222.0.24 () {58 vars in 1274 bytes} [Tue May 17 22:15:23 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:15:23.295823 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-aa3c665e-6242-4493-a81c-c4570a3c2539 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:23.296343 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-aa3c665e-6242-4493-a81c-c4570a3c2539 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:23.304339 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aa3c665e-6242-4493-a81c-c4570a3c2539 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:23.308029 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aa3c665e-6242-4493-a81c-c4570a3c2539 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:23.308029 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aa3c665e-6242-4493-a81c-c4570a3c2539 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:23.308029 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aa3c665e-6242-4493-a81c-c4570a3c2539 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:23.332587 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-aa3c665e-6242-4493-a81c-c4570a3c2539 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lazy-loading 'flavor' on Instance uuid 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:15:24.036587 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-aa3c665e-6242-4493-a81c-c4570a3c2539 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "POST /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/action" status: 202 len: 0 microversion: 2.20 time: 0.743858 May 17 22:15:24.038043 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 471/966] 10.222.0.24 () {62 vars in 1318 bytes} [Tue May 17 22:15:23 2022] POST /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/action => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 22:15:24.045666 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-dbf92835-919e-4107-a2d3-3feccec539c0 req-5916f08c-d7ea-4b81-a1d0-0fddd88aea4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11fe4fe4-16e9-4a9d-a0cf-954d520222c2", "tag": "9c8d665a-b5a0-45a4-a0ba-7f36817e2db3"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:24.055838 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-dbf92835-919e-4107-a2d3-3feccec539c0 req-5916f08c-d7ea-4b81-a1d0-0fddd88aea4c service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:24.056576 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-dbf92835-919e-4107-a2d3-3feccec539c0 req-5916f08c-d7ea-4b81-a1d0-0fddd88aea4c service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:24.069411 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-dbf92835-919e-4107-a2d3-3feccec539c0 req-5916f08c-d7ea-4b81-a1d0-0fddd88aea4c service nova] Creating event network-changed:9c8d665a-b5a0-45a4-a0ba-7f36817e2db3 for instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 on hv-cinder-83998 May 17 22:15:24.074902 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-dbf92835-919e-4107-a2d3-3feccec539c0 req-5916f08c-d7ea-4b81-a1d0-0fddd88aea4c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035315 May 17 22:15:24.075731 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 472/967] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:24.081120 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cd3b9f8c-d01c-4da5-a908-4b53a90196e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:24.081837 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cd3b9f8c-d01c-4da5-a908-4b53a90196e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:24.088706 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd3b9f8c-d01c-4da5-a908-4b53a90196e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:24.089147 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd3b9f8c-d01c-4da5-a908-4b53a90196e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:24.090569 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd3b9f8c-d01c-4da5-a908-4b53a90196e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:24.091003 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cd3b9f8c-d01c-4da5-a908-4b53a90196e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:24.243176 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cd3b9f8c-d01c-4da5-a908-4b53a90196e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:24.251775 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cd3b9f8c-d01c-4da5-a908-4b53a90196e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:24.253297 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cd3b9f8c-d01c-4da5-a908-4b53a90196e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:24.255025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cd3b9f8c-d01c-4da5-a908-4b53a90196e1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.177839 May 17 22:15:24.255619 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 473/968] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:24 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:24.324501 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-a7264624-0322-4a2b-80f9-eea6693ae55c req-567619d0-f03e-4644-ac48-108098ed72a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3fa9042-8c2f-46bd-8570-97f8e8585216", "tag": "d95aec15-6d35-4b78-ab7f-a8a90baf08e7"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:24.332944 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-a7264624-0322-4a2b-80f9-eea6693ae55c req-567619d0-f03e-4644-ac48-108098ed72a3 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:24.333660 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-a7264624-0322-4a2b-80f9-eea6693ae55c req-567619d0-f03e-4644-ac48-108098ed72a3 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:24.507262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-a7264624-0322-4a2b-80f9-eea6693ae55c req-567619d0-f03e-4644-ac48-108098ed72a3 service nova] Creating event network-changed:d95aec15-6d35-4b78-ab7f-a8a90baf08e7 for instance f3fa9042-8c2f-46bd-8570-97f8e8585216 on hv-cinder-83998 May 17 22:15:24.512266 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-a7264624-0322-4a2b-80f9-eea6693ae55c req-567619d0-f03e-4644-ac48-108098ed72a3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191355 May 17 22:15:24.512871 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 474/969] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:15:25.274192 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-53c94d54-9a91-47cf-926b-0efb6070574d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:25.275050 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-53c94d54-9a91-47cf-926b-0efb6070574d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:25.281513 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53c94d54-9a91-47cf-926b-0efb6070574d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:25.281993 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53c94d54-9a91-47cf-926b-0efb6070574d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:25.282780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53c94d54-9a91-47cf-926b-0efb6070574d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:25.283241 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-53c94d54-9a91-47cf-926b-0efb6070574d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:25.426975 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-53c94d54-9a91-47cf-926b-0efb6070574d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:25.435666 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-53c94d54-9a91-47cf-926b-0efb6070574d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:25.437567 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-53c94d54-9a91-47cf-926b-0efb6070574d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:25.438660 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-53c94d54-9a91-47cf-926b-0efb6070574d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.169666 May 17 22:15:25.443643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 475/970] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:25 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:15:26.161005 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fd924bca-5296-4c61-910a-b3e6cee042b8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "POST /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.242642 May 17 22:15:26.162004 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 496/971] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:15:22 2022] POST /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments => generated 194 bytes in 3245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:15:26.465957 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-496dcf98-fdaf-42fd-babd-4a9f2f05193d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:26.466776 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-496dcf98-fdaf-42fd-babd-4a9f2f05193d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:26.473295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-496dcf98-fdaf-42fd-babd-4a9f2f05193d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:26.473826 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-496dcf98-fdaf-42fd-babd-4a9f2f05193d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:26.474700 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-496dcf98-fdaf-42fd-babd-4a9f2f05193d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:26.475240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-496dcf98-fdaf-42fd-babd-4a9f2f05193d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:26.711056 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-496dcf98-fdaf-42fd-babd-4a9f2f05193d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:26.719519 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-496dcf98-fdaf-42fd-babd-4a9f2f05193d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:26.720911 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-496dcf98-fdaf-42fd-babd-4a9f2f05193d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:26.722816 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-496dcf98-fdaf-42fd-babd-4a9f2f05193d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.260067 May 17 22:15:26.730904 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 476/972] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:26 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:27.742942 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6653ddf2-cb19-448d-bfd8-964a58516969 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:27.743675 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6653ddf2-cb19-448d-bfd8-964a58516969 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:27.749844 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6653ddf2-cb19-448d-bfd8-964a58516969 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:27.750291 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6653ddf2-cb19-448d-bfd8-964a58516969 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:27.751048 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6653ddf2-cb19-448d-bfd8-964a58516969 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:27.751506 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6653ddf2-cb19-448d-bfd8-964a58516969 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:27.887860 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6653ddf2-cb19-448d-bfd8-964a58516969 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:27.896156 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6653ddf2-cb19-448d-bfd8-964a58516969 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:27.897706 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6653ddf2-cb19-448d-bfd8-964a58516969 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:27.902448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6653ddf2-cb19-448d-bfd8-964a58516969 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.161203 May 17 22:15:27.902448 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 497/973] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:27 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:28.917000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-bcc6fcc4-1aac-4a2f-9997-6dc731d9a37e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:28.921674 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-bcc6fcc4-1aac-4a2f-9997-6dc731d9a37e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:28.924124 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bcc6fcc4-1aac-4a2f-9997-6dc731d9a37e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:28.924574 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bcc6fcc4-1aac-4a2f-9997-6dc731d9a37e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:28.925477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bcc6fcc4-1aac-4a2f-9997-6dc731d9a37e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:28.925814 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-bcc6fcc4-1aac-4a2f-9997-6dc731d9a37e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:29.052782 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bcc6fcc4-1aac-4a2f-9997-6dc731d9a37e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:29.060609 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bcc6fcc4-1aac-4a2f-9997-6dc731d9a37e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:29.062371 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-bcc6fcc4-1aac-4a2f-9997-6dc731d9a37e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:29.063554 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-bcc6fcc4-1aac-4a2f-9997-6dc731d9a37e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.150429 May 17 22:15:29.064103 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 477/974] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:28 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:30.082724 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c7ea4013-9ff5-4620-87af-052d6deef966 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:30.083354 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c7ea4013-9ff5-4620-87af-052d6deef966 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:30.089653 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c7ea4013-9ff5-4620-87af-052d6deef966 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:30.090090 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c7ea4013-9ff5-4620-87af-052d6deef966 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:30.090845 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c7ea4013-9ff5-4620-87af-052d6deef966 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:30.091310 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c7ea4013-9ff5-4620-87af-052d6deef966 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:30.219493 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c7ea4013-9ff5-4620-87af-052d6deef966 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:30.227750 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c7ea4013-9ff5-4620-87af-052d6deef966 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:30.229224 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c7ea4013-9ff5-4620-87af-052d6deef966 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:30.230367 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c7ea4013-9ff5-4620-87af-052d6deef966 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.152308 May 17 22:15:30.230915 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 498/975] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:30 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:31.248593 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2ef4a377-4e0f-4cc9-b345-20e14b341e75 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:31.249138 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-2ef4a377-4e0f-4cc9-b345-20e14b341e75 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:31.256339 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2ef4a377-4e0f-4cc9-b345-20e14b341e75 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:31.256794 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2ef4a377-4e0f-4cc9-b345-20e14b341e75 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:31.257566 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2ef4a377-4e0f-4cc9-b345-20e14b341e75 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:31.258007 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-2ef4a377-4e0f-4cc9-b345-20e14b341e75 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:31.387301 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2ef4a377-4e0f-4cc9-b345-20e14b341e75 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:31.396266 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2ef4a377-4e0f-4cc9-b345-20e14b341e75 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:31.397861 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-2ef4a377-4e0f-4cc9-b345-20e14b341e75 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:31.399094 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2ef4a377-4e0f-4cc9-b345-20e14b341e75 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.154614 May 17 22:15:31.399780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 478/976] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:31 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:32.417533 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4a63af24-79ba-41a7-8398-3e6bfceca5b4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:32.418146 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4a63af24-79ba-41a7-8398-3e6bfceca5b4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:32.424514 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a63af24-79ba-41a7-8398-3e6bfceca5b4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:32.425020 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a63af24-79ba-41a7-8398-3e6bfceca5b4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:32.425790 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a63af24-79ba-41a7-8398-3e6bfceca5b4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:32.426226 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a63af24-79ba-41a7-8398-3e6bfceca5b4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:32.561394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4a63af24-79ba-41a7-8398-3e6bfceca5b4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:32.569435 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4a63af24-79ba-41a7-8398-3e6bfceca5b4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:32.570924 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4a63af24-79ba-41a7-8398-3e6bfceca5b4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:32.572113 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4a63af24-79ba-41a7-8398-3e6bfceca5b4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.158577 May 17 22:15:32.572680 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 499/977] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:32 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:15:33.591330 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-347242a7-551b-416c-aedf-a2382cdaf116 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:33.592025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-347242a7-551b-416c-aedf-a2382cdaf116 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:33.598831 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-347242a7-551b-416c-aedf-a2382cdaf116 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:33.599311 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-347242a7-551b-416c-aedf-a2382cdaf116 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:33.600084 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-347242a7-551b-416c-aedf-a2382cdaf116 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:33.600515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-347242a7-551b-416c-aedf-a2382cdaf116 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:33.649714 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-21939904-7b5d-40e5-b214-40441b664ef1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:33.650810 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-21939904-7b5d-40e5-b214-40441b664ef1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:33.657189 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-21939904-7b5d-40e5-b214-40441b664ef1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:33.657776 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-21939904-7b5d-40e5-b214-40441b664ef1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:33.658543 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-21939904-7b5d-40e5-b214-40441b664ef1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:33.658971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-21939904-7b5d-40e5-b214-40441b664ef1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:33.690916 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-21939904-7b5d-40e5-b214-40441b664ef1 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 May 17 22:15:33.691867 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 500/978] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:15:33 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:15:33.701543 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f27cccb3-0c15-46d4-9484-cb866dd74794 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:33.702028 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f27cccb3-0c15-46d4-9484-cb866dd74794 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:33.708748 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f27cccb3-0c15-46d4-9484-cb866dd74794 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:33.709192 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f27cccb3-0c15-46d4-9484-cb866dd74794 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:33.709964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f27cccb3-0c15-46d4-9484-cb866dd74794 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:33.710374 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f27cccb3-0c15-46d4-9484-cb866dd74794 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:33.739019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f27cccb3-0c15-46d4-9484-cb866dd74794 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments/e39c7aff-d027-4689-942b-458e5a4c94b6" status: 200 len: 194 microversion: 2.1 time: 0.041228 May 17 22:15:33.739641 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 501/979] 10.222.0.24 () {58 vars in 1412 bytes} [Tue May 17 22:15:33 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments/e39c7aff-d027-4689-942b-458e5a4c94b6 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:15:33.740100 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-347242a7-551b-416c-aedf-a2382cdaf116 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:33.748321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-347242a7-551b-416c-aedf-a2382cdaf116 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:33.749819 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-347242a7-551b-416c-aedf-a2382cdaf116 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:33.750976 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-347242a7-551b-416c-aedf-a2382cdaf116 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.163702 May 17 22:15:33.751551 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 479/980] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:33 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:34.770302 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d2d47163-5eea-497c-8bf1-147f0dce7a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:34.770835 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d2d47163-5eea-497c-8bf1-147f0dce7a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:34.777124 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2d47163-5eea-497c-8bf1-147f0dce7a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:34.777566 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2d47163-5eea-497c-8bf1-147f0dce7a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:34.778329 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2d47163-5eea-497c-8bf1-147f0dce7a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:34.778761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d2d47163-5eea-497c-8bf1-147f0dce7a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:34.906152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d2d47163-5eea-497c-8bf1-147f0dce7a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:34.914315 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d2d47163-5eea-497c-8bf1-147f0dce7a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:34.915847 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d2d47163-5eea-497c-8bf1-147f0dce7a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:34.917006 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d2d47163-5eea-497c-8bf1-147f0dce7a1e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.151288 May 17 22:15:34.917561 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 502/981] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:34 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:35.935321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d682e50a-7335-4587-87b1-93517b820753 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:35.935957 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d682e50a-7335-4587-87b1-93517b820753 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:35.943780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d682e50a-7335-4587-87b1-93517b820753 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:35.944244 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d682e50a-7335-4587-87b1-93517b820753 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:35.945031 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d682e50a-7335-4587-87b1-93517b820753 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:35.945465 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d682e50a-7335-4587-87b1-93517b820753 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:36.079969 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d682e50a-7335-4587-87b1-93517b820753 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:36.087842 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d682e50a-7335-4587-87b1-93517b820753 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:36.091721 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d682e50a-7335-4587-87b1-93517b820753 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:36.091721 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d682e50a-7335-4587-87b1-93517b820753 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.159184 May 17 22:15:36.091721 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 480/982] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:35 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:37.108754 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f0f0c74c-d40f-4261-a077-07ea5f3fbdfd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:37.109339 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f0f0c74c-d40f-4261-a077-07ea5f3fbdfd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:37.116392 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0f0c74c-d40f-4261-a077-07ea5f3fbdfd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:37.116837 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0f0c74c-d40f-4261-a077-07ea5f3fbdfd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:37.117607 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0f0c74c-d40f-4261-a077-07ea5f3fbdfd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:37.118038 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f0f0c74c-d40f-4261-a077-07ea5f3fbdfd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:37.244207 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f0f0c74c-d40f-4261-a077-07ea5f3fbdfd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:37.252069 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f0f0c74c-d40f-4261-a077-07ea5f3fbdfd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:37.253987 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f0f0c74c-d40f-4261-a077-07ea5f3fbdfd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:37.255177 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f0f0c74c-d40f-4261-a077-07ea5f3fbdfd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.150394 May 17 22:15:37.255733 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 503/983] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:37 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:37.556784 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d10cffb4-1a36-4e86-8c69-7e520fb7ce2c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8ec16d8-2af7-4aed-b659-2b873e8c4b49"}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:37.557842 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d10cffb4-1a36-4e86-8c69-7e520fb7ce2c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:37.564734 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d10cffb4-1a36-4e86-8c69-7e520fb7ce2c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:37.565182 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d10cffb4-1a36-4e86-8c69-7e520fb7ce2c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:37.566076 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d10cffb4-1a36-4e86-8c69-7e520fb7ce2c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:37.566515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d10cffb4-1a36-4e86-8c69-7e520fb7ce2c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:38.273220 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e6a34718-c495-41f8-bbee-aeaf0baa6802 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:38.273821 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e6a34718-c495-41f8-bbee-aeaf0baa6802 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:38.280729 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e6a34718-c495-41f8-bbee-aeaf0baa6802 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:38.281176 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e6a34718-c495-41f8-bbee-aeaf0baa6802 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:38.281939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e6a34718-c495-41f8-bbee-aeaf0baa6802 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:38.282371 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e6a34718-c495-41f8-bbee-aeaf0baa6802 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:38.358785 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d10cffb4-1a36-4e86-8c69-7e520fb7ce2c tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "POST /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805515 May 17 22:15:38.359386 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 481/984] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:15:37 2022] POST /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:38.414968 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e6a34718-c495-41f8-bbee-aeaf0baa6802 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:38.422880 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e6a34718-c495-41f8-bbee-aeaf0baa6802 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:38.424424 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e6a34718-c495-41f8-bbee-aeaf0baa6802 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:38.426396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e6a34718-c495-41f8-bbee-aeaf0baa6802 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.157283 May 17 22:15:38.426961 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 504/985] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:38 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:15:39.450570 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-3e539ab9-89be-45ed-8807-18a908d81751 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:39.451341 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-3e539ab9-89be-45ed-8807-18a908d81751 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:39.458017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3e539ab9-89be-45ed-8807-18a908d81751 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:39.458329 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3e539ab9-89be-45ed-8807-18a908d81751 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:39.459117 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3e539ab9-89be-45ed-8807-18a908d81751 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:39.459559 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-3e539ab9-89be-45ed-8807-18a908d81751 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:39.590794 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3e539ab9-89be-45ed-8807-18a908d81751 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:39.599060 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3e539ab9-89be-45ed-8807-18a908d81751 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:39.600559 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-3e539ab9-89be-45ed-8807-18a908d81751 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:39.601710 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-3e539ab9-89be-45ed-8807-18a908d81751 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.155767 May 17 22:15:39.602267 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 482/986] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:39 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:40.620172 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-abb155da-738e-4370-a4da-70491ea07119 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:40.620776 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-abb155da-738e-4370-a4da-70491ea07119 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:40.627084 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-abb155da-738e-4370-a4da-70491ea07119 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:40.627560 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-abb155da-738e-4370-a4da-70491ea07119 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:40.628323 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-abb155da-738e-4370-a4da-70491ea07119 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:40.629428 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-abb155da-738e-4370-a4da-70491ea07119 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:40.752783 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-abb155da-738e-4370-a4da-70491ea07119 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:40.761362 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-abb155da-738e-4370-a4da-70491ea07119 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:40.762849 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-abb155da-738e-4370-a4da-70491ea07119 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:40.764024 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-abb155da-738e-4370-a4da-70491ea07119 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.147840 May 17 22:15:40.764577 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 505/987] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:40 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:41.781872 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-73901ecc-54e7-486c-87eb-174bdf7d34cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:41.782504 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-73901ecc-54e7-486c-87eb-174bdf7d34cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:41.789560 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73901ecc-54e7-486c-87eb-174bdf7d34cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:41.790009 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73901ecc-54e7-486c-87eb-174bdf7d34cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:41.790769 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73901ecc-54e7-486c-87eb-174bdf7d34cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:41.791240 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73901ecc-54e7-486c-87eb-174bdf7d34cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:41.931087 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-73901ecc-54e7-486c-87eb-174bdf7d34cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:41.939173 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-73901ecc-54e7-486c-87eb-174bdf7d34cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:41.940675 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-73901ecc-54e7-486c-87eb-174bdf7d34cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:41.941977 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-73901ecc-54e7-486c-87eb-174bdf7d34cd tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.164034 May 17 22:15:41.942531 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 483/988] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:41 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:42.960306 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1973491b-6866-436d-ae03-f7fc337fe1b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:42.961026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1973491b-6866-436d-ae03-f7fc337fe1b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:42.967324 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1973491b-6866-436d-ae03-f7fc337fe1b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:42.967769 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1973491b-6866-436d-ae03-f7fc337fe1b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:42.968529 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1973491b-6866-436d-ae03-f7fc337fe1b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:42.968959 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1973491b-6866-436d-ae03-f7fc337fe1b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:43.095883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1973491b-6866-436d-ae03-f7fc337fe1b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:43.104232 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1973491b-6866-436d-ae03-f7fc337fe1b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:43.105713 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1973491b-6866-436d-ae03-f7fc337fe1b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:43.106883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1973491b-6866-436d-ae03-f7fc337fe1b0 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1740 microversion: 2.20 time: 0.150685 May 17 22:15:43.107428 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 506/989] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:42 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:44.125785 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5d90b439-2001-4b2f-9139-40dba129718c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:44.126405 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5d90b439-2001-4b2f-9139-40dba129718c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:44.133235 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d90b439-2001-4b2f-9139-40dba129718c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:44.133683 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d90b439-2001-4b2f-9139-40dba129718c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:44.134446 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d90b439-2001-4b2f-9139-40dba129718c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:44.134889 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5d90b439-2001-4b2f-9139-40dba129718c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:44.272691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5d90b439-2001-4b2f-9139-40dba129718c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:44.278745 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5d90b439-2001-4b2f-9139-40dba129718c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:44.280296 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5d90b439-2001-4b2f-9139-40dba129718c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:44.281476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5d90b439-2001-4b2f-9139-40dba129718c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1740 microversion: 2.20 time: 0.159613 May 17 22:15:44.282036 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 484/990] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:44 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:45.299679 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b806be66-9766-48b1-bdc1-b9f1eae82487 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:45.300314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b806be66-9766-48b1-bdc1-b9f1eae82487 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:45.306639 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b806be66-9766-48b1-bdc1-b9f1eae82487 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:45.307090 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b806be66-9766-48b1-bdc1-b9f1eae82487 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:45.307881 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b806be66-9766-48b1-bdc1-b9f1eae82487 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:45.308315 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b806be66-9766-48b1-bdc1-b9f1eae82487 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:45.434071 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b806be66-9766-48b1-bdc1-b9f1eae82487 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:45.442821 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b806be66-9766-48b1-bdc1-b9f1eae82487 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:45.444351 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b806be66-9766-48b1-bdc1-b9f1eae82487 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:45.445488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b806be66-9766-48b1-bdc1-b9f1eae82487 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1740 microversion: 2.20 time: 0.149732 May 17 22:15:45.446179 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 507/991] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:45 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:46.463606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e3ba7bcd-d5cc-47f3-9d7c-fab0b3aaea76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:46.464118 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e3ba7bcd-d5cc-47f3-9d7c-fab0b3aaea76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:46.470373 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3ba7bcd-d5cc-47f3-9d7c-fab0b3aaea76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:46.470829 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3ba7bcd-d5cc-47f3-9d7c-fab0b3aaea76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:46.471625 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3ba7bcd-d5cc-47f3-9d7c-fab0b3aaea76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:46.472593 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3ba7bcd-d5cc-47f3-9d7c-fab0b3aaea76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:46.601315 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e3ba7bcd-d5cc-47f3-9d7c-fab0b3aaea76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:46.608850 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e3ba7bcd-d5cc-47f3-9d7c-fab0b3aaea76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:46.610314 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e3ba7bcd-d5cc-47f3-9d7c-fab0b3aaea76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:46.611479 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e3ba7bcd-d5cc-47f3-9d7c-fab0b3aaea76 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1740 microversion: 2.20 time: 0.151894 May 17 22:15:46.612032 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 485/992] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:46 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:46.850427 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-caa4432b-7b6e-4087-8493-621a0fddb578 req-516ee0bc-9d9b-4f66-a30b-7b67cf077048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c", "name": "network-vif-plugged", "status": "completed", "tag": "01f9ff90-5b71-4555-bb92-f5d36e9518eb"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:46.858885 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-caa4432b-7b6e-4087-8493-621a0fddb578 req-516ee0bc-9d9b-4f66-a30b-7b67cf077048 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:46.859350 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-caa4432b-7b6e-4087-8493-621a0fddb578 req-516ee0bc-9d9b-4f66-a30b-7b67cf077048 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:46.870653 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-caa4432b-7b6e-4087-8493-621a0fddb578 req-516ee0bc-9d9b-4f66-a30b-7b67cf077048 service nova] Creating event network-vif-plugged:01f9ff90-5b71-4555-bb92-f5d36e9518eb for instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c on hv-cinder-83998 May 17 22:15:46.875901 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-caa4432b-7b6e-4087-8493-621a0fddb578 req-516ee0bc-9d9b-4f66-a30b-7b67cf077048 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029813 May 17 22:15:46.876537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 508/993] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:47.629872 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8710f5af-3987-4d0c-8783-fc782cb5581c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:47.630521 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8710f5af-3987-4d0c-8783-fc782cb5581c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:47.636794 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8710f5af-3987-4d0c-8783-fc782cb5581c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:47.637242 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8710f5af-3987-4d0c-8783-fc782cb5581c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:47.638054 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8710f5af-3987-4d0c-8783-fc782cb5581c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:47.638483 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8710f5af-3987-4d0c-8783-fc782cb5581c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:47.768271 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8710f5af-3987-4d0c-8783-fc782cb5581c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:47.776606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8710f5af-3987-4d0c-8783-fc782cb5581c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:47.778082 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8710f5af-3987-4d0c-8783-fc782cb5581c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:47.780052 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8710f5af-3987-4d0c-8783-fc782cb5581c tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1740 microversion: 2.20 time: 0.153907 May 17 22:15:47.781028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 486/994] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:47 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:48.803617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-47971290-d69f-4b1d-8523-27e68f80ee4d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:48.804315 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-47971290-d69f-4b1d-8523-27e68f80ee4d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:48.811198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47971290-d69f-4b1d-8523-27e68f80ee4d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:48.811198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47971290-d69f-4b1d-8523-27e68f80ee4d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:48.812253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47971290-d69f-4b1d-8523-27e68f80ee4d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:48.812695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47971290-d69f-4b1d-8523-27e68f80ee4d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:48.965738 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-47971290-d69f-4b1d-8523-27e68f80ee4d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:48.971478 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-47971290-d69f-4b1d-8523-27e68f80ee4d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:48.973397 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-47971290-d69f-4b1d-8523-27e68f80ee4d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:48.974624 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-47971290-d69f-4b1d-8523-27e68f80ee4d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1735 microversion: 2.20 time: 0.176694 May 17 22:15:48.985517 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 509/995] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:48 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:49.026833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6fa41d96-c4d7-4113-a307-8dab4633d248 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:49.028035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6fa41d96-c4d7-4113-a307-8dab4633d248 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:49.034523 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6fa41d96-c4d7-4113-a307-8dab4633d248 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:49.035279 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6fa41d96-c4d7-4113-a307-8dab4633d248 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:49.036053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6fa41d96-c4d7-4113-a307-8dab4633d248 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:49.036492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6fa41d96-c4d7-4113-a307-8dab4633d248 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:49.069545 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6fa41d96-c4d7-4113-a307-8dab4633d248 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046764 May 17 22:15:49.073397 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 487/996] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:15:49 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:49.223438 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-41376504-a582-41d4-b25d-bca128595104 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:49.224047 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-41376504-a582-41d4-b25d-bca128595104 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:49.230113 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41376504-a582-41d4-b25d-bca128595104 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:49.230565 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41376504-a582-41d4-b25d-bca128595104 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:49.231375 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41376504-a582-41d4-b25d-bca128595104 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:49.231812 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-41376504-a582-41d4-b25d-bca128595104 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:49.260881 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-41376504-a582-41d4-b25d-bca128595104 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments/e39c7aff-d027-4689-942b-458e5a4c94b6" status: 200 len: 194 microversion: 2.1 time: 0.041531 May 17 22:15:49.261376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 510/997] 10.222.0.24 () {58 vars in 1412 bytes} [Tue May 17 22:15:49 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments/e39c7aff-d027-4689-942b-458e5a4c94b6 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:49.272170 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-414cb46d-ec1d-4174-af47-9f36b6800bf9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:49.272672 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-414cb46d-ec1d-4174-af47-9f36b6800bf9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:49.278517 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-414cb46d-ec1d-4174-af47-9f36b6800bf9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:49.282108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-414cb46d-ec1d-4174-af47-9f36b6800bf9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:49.282108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-414cb46d-ec1d-4174-af47-9f36b6800bf9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:49.282108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-414cb46d-ec1d-4174-af47-9f36b6800bf9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:49.364115 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-414cb46d-ec1d-4174-af47-9f36b6800bf9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lazy-loading 'services' on Instance uuid 8d4d36e2-0f10-4434-ad5d-cc27b81e923e {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:15:49.697017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-414cb46d-ec1d-4174-af47-9f36b6800bf9 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments/e39c7aff-d027-4689-942b-458e5a4c94b6" status: 202 len: 0 microversion: 2.1 time: 0.429582 May 17 22:15:49.701396 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 488/998] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 17 22:15:49 2022] DELETE /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments/e39c7aff-d027-4689-942b-458e5a4c94b6 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:15:49.994628 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e27146df-cd3f-4204-ac8f-019305d3cbfb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:49.995295 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e27146df-cd3f-4204-ac8f-019305d3cbfb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:50.006162 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e27146df-cd3f-4204-ac8f-019305d3cbfb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:50.006938 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e27146df-cd3f-4204-ac8f-019305d3cbfb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:50.007950 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e27146df-cd3f-4204-ac8f-019305d3cbfb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:50.008389 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e27146df-cd3f-4204-ac8f-019305d3cbfb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:50.183683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e27146df-cd3f-4204-ac8f-019305d3cbfb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:50.193132 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e27146df-cd3f-4204-ac8f-019305d3cbfb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:50.194637 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e27146df-cd3f-4204-ac8f-019305d3cbfb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:50.195831 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e27146df-cd3f-4204-ac8f-019305d3cbfb tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1735 microversion: 2.20 time: 0.205706 May 17 22:15:50.196493 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 511/999] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:49 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:51.215052 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-aa1f63d0-0adc-42a8-879d-b9455ec0f339 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:51.216508 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-aa1f63d0-0adc-42a8-879d-b9455ec0f339 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:51.239459 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aa1f63d0-0adc-42a8-879d-b9455ec0f339 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:51.240042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aa1f63d0-0adc-42a8-879d-b9455ec0f339 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:51.241943 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aa1f63d0-0adc-42a8-879d-b9455ec0f339 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:51.242567 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-aa1f63d0-0adc-42a8-879d-b9455ec0f339 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:51.430948 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-aa1f63d0-0adc-42a8-879d-b9455ec0f339 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:51.440954 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-aa1f63d0-0adc-42a8-879d-b9455ec0f339 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:51.442653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-aa1f63d0-0adc-42a8-879d-b9455ec0f339 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:51.444005 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-aa1f63d0-0adc-42a8-879d-b9455ec0f339 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1735 microversion: 2.20 time: 0.233791 May 17 22:15:51.455484 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 489/1000] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:51 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1735 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:51.901907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e1582a06-af45-4e83-a1f0-1e4f247d5e12 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:51.904151 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e1582a06-af45-4e83-a1f0-1e4f247d5e12 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:51.917856 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1582a06-af45-4e83-a1f0-1e4f247d5e12 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:51.918661 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1582a06-af45-4e83-a1f0-1e4f247d5e12 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:51.919687 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1582a06-af45-4e83-a1f0-1e4f247d5e12 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:51.920327 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e1582a06-af45-4e83-a1f0-1e4f247d5e12 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:51.953767 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e1582a06-af45-4e83-a1f0-1e4f247d5e12 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments/a8ec16d8-2af7-4aed-b659-2b873e8c4b49" status: 200 len: 194 microversion: 2.1 time: 0.061847 May 17 22:15:51.954946 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 512/1001] 10.222.0.24 () {58 vars in 1412 bytes} [Tue May 17 22:15:51 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments/a8ec16d8-2af7-4aed-b659-2b873e8c4b49 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:51.966539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-85c42332-462c-4f25-b561-8f7f5173c3fb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:51.967141 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-85c42332-462c-4f25-b561-8f7f5173c3fb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:51.974055 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-85c42332-462c-4f25-b561-8f7f5173c3fb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:51.974772 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-85c42332-462c-4f25-b561-8f7f5173c3fb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:51.976026 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-85c42332-462c-4f25-b561-8f7f5173c3fb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:51.976758 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-85c42332-462c-4f25-b561-8f7f5173c3fb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:52.077345 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-85c42332-462c-4f25-b561-8f7f5173c3fb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lazy-loading 'services' on Instance uuid 8d4d36e2-0f10-4434-ad5d-cc27b81e923e {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:15:52.463265 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4f7cd40c-ec60-44b9-a0c4-65674db8e3d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:52.463901 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4f7cd40c-ec60-44b9-a0c4-65674db8e3d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:52.470156 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f7cd40c-ec60-44b9-a0c4-65674db8e3d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:52.470638 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f7cd40c-ec60-44b9-a0c4-65674db8e3d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:52.471609 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f7cd40c-ec60-44b9-a0c4-65674db8e3d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:52.472677 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4f7cd40c-ec60-44b9-a0c4-65674db8e3d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:52.609652 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4f7cd40c-ec60-44b9-a0c4-65674db8e3d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:52.618504 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4f7cd40c-ec60-44b9-a0c4-65674db8e3d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:52.620015 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4f7cd40c-ec60-44b9-a0c4-65674db8e3d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:52.621362 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4f7cd40c-ec60-44b9-a0c4-65674db8e3d3 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1735 microversion: 2.20 time: 0.162541 May 17 22:15:52.622039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 513/1002] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:52 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:15:52.662685 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-85c42332-462c-4f25-b561-8f7f5173c3fb tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments/a8ec16d8-2af7-4aed-b659-2b873e8c4b49" status: 202 len: 0 microversion: 2.1 time: 0.700187 May 17 22:15:52.663302 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 490/1003] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 17 22:15:51 2022] DELETE /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments/a8ec16d8-2af7-4aed-b659-2b873e8c4b49 => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:15:53.641247 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f87cda59-d404-49f7-8faa-65e646f70071 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:53.641925 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f87cda59-d404-49f7-8faa-65e646f70071 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:53.649326 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f87cda59-d404-49f7-8faa-65e646f70071 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:53.649769 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f87cda59-d404-49f7-8faa-65e646f70071 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:53.650542 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f87cda59-d404-49f7-8faa-65e646f70071 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:53.650974 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f87cda59-d404-49f7-8faa-65e646f70071 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:53.814783 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f87cda59-d404-49f7-8faa-65e646f70071 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:53.855404 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f87cda59-d404-49f7-8faa-65e646f70071 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:53.865778 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f87cda59-d404-49f7-8faa-65e646f70071 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:53.867669 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f87cda59-d404-49f7-8faa-65e646f70071 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1735 microversion: 2.20 time: 0.230407 May 17 22:15:53.868765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 514/1004] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:53 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:15:53.873582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4cfe0e2d-8296-43dc-b74e-d797073e8b21 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:53.874660 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4cfe0e2d-8296-43dc-b74e-d797073e8b21 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:53.883198 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cfe0e2d-8296-43dc-b74e-d797073e8b21 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:53.883986 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cfe0e2d-8296-43dc-b74e-d797073e8b21 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:53.885034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cfe0e2d-8296-43dc-b74e-d797073e8b21 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:53.885634 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4cfe0e2d-8296-43dc-b74e-d797073e8b21 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:53.921111 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4cfe0e2d-8296-43dc-b74e-d797073e8b21 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052454 May 17 22:15:53.927157 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 491/1005] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:15:53 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 22:15:54.045896 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e698883b-644d-4cd7-b3ed-dc7e39f49165 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:54.047255 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e698883b-644d-4cd7-b3ed-dc7e39f49165 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:54.056114 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e698883b-644d-4cd7-b3ed-dc7e39f49165 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:54.056562 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e698883b-644d-4cd7-b3ed-dc7e39f49165 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:54.057397 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e698883b-644d-4cd7-b3ed-dc7e39f49165 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:54.057854 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e698883b-644d-4cd7-b3ed-dc7e39f49165 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:54.094008 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e698883b-644d-4cd7-b3ed-dc7e39f49165 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052139 May 17 22:15:54.095251 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 515/1006] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:15:54 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 22:15:54.160466 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-03ea4cf4-b2e0-4196-a0bb-cc03eae53c94 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:54.161050 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-03ea4cf4-b2e0-4196-a0bb-cc03eae53c94 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:54.167409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-03ea4cf4-b2e0-4196-a0bb-cc03eae53c94 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:54.167952 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-03ea4cf4-b2e0-4196-a0bb-cc03eae53c94 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:54.168806 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-03ea4cf4-b2e0-4196-a0bb-cc03eae53c94 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:54.169314 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-03ea4cf4-b2e0-4196-a0bb-cc03eae53c94 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:54.197158 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-03ea4cf4-b2e0-4196-a0bb-cc03eae53c94 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:15:54.611869 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-03ea4cf4-b2e0-4196-a0bb-cc03eae53c94 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 204 len: 0 microversion: 2.1 time: 0.455144 May 17 22:15:54.613621 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 492/1007] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:15:54 2022] DELETE /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:15:54.621995 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1485a705-4d40-46f2-bb1b-afdae0eb6ac7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:54.626068 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1485a705-4d40-46f2-bb1b-afdae0eb6ac7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:54.629197 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1485a705-4d40-46f2-bb1b-afdae0eb6ac7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:54.629653 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1485a705-4d40-46f2-bb1b-afdae0eb6ac7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:54.630463 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1485a705-4d40-46f2-bb1b-afdae0eb6ac7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:54.630899 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1485a705-4d40-46f2-bb1b-afdae0eb6ac7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:54.773610 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1485a705-4d40-46f2-bb1b-afdae0eb6ac7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:54.781303 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1485a705-4d40-46f2-bb1b-afdae0eb6ac7 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1672 microversion: 2.1 time: 0.163263 May 17 22:15:54.781876 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 516/1008] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:54 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:54.895786 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-cdcfad14-552a-4c11-8a9e-599bc2097f65 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:54.896519 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-cdcfad14-552a-4c11-8a9e-599bc2097f65 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:54.906089 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cdcfad14-552a-4c11-8a9e-599bc2097f65 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:54.906943 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cdcfad14-552a-4c11-8a9e-599bc2097f65 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:54.908002 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cdcfad14-552a-4c11-8a9e-599bc2097f65 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:54.908910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-cdcfad14-552a-4c11-8a9e-599bc2097f65 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:55.069599 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cdcfad14-552a-4c11-8a9e-599bc2097f65 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:55.078666 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cdcfad14-552a-4c11-8a9e-599bc2097f65 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:55.080169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-cdcfad14-552a-4c11-8a9e-599bc2097f65 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:55.081363 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-cdcfad14-552a-4c11-8a9e-599bc2097f65 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1735 microversion: 2.20 time: 0.198080 May 17 22:15:55.082255 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 493/1009] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:54 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:55.799496 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-621591cd-51fa-4d80-99ae-e5fa5ace701b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:55.800741 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-621591cd-51fa-4d80-99ae-e5fa5ace701b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:55.807408 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-621591cd-51fa-4d80-99ae-e5fa5ace701b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:55.807853 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-621591cd-51fa-4d80-99ae-e5fa5ace701b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:55.808618 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-621591cd-51fa-4d80-99ae-e5fa5ace701b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:55.809049 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-621591cd-51fa-4d80-99ae-e5fa5ace701b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:55.959815 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-621591cd-51fa-4d80-99ae-e5fa5ace701b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:55.967198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-621591cd-51fa-4d80-99ae-e5fa5ace701b tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1672 microversion: 2.1 time: 0.171566 May 17 22:15:55.967656 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 517/1010] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:55 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:56.099661 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-98779391-63a4-4e53-b766-ecf81ca24483 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:56.100198 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-98779391-63a4-4e53-b766-ecf81ca24483 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:56.106540 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-98779391-63a4-4e53-b766-ecf81ca24483 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:56.106992 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-98779391-63a4-4e53-b766-ecf81ca24483 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:56.107791 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-98779391-63a4-4e53-b766-ecf81ca24483 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:56.108229 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-98779391-63a4-4e53-b766-ecf81ca24483 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:56.243763 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-98779391-63a4-4e53-b766-ecf81ca24483 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:56.251744 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-98779391-63a4-4e53-b766-ecf81ca24483 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:56.254305 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-98779391-63a4-4e53-b766-ecf81ca24483 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:56.255592 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-98779391-63a4-4e53-b766-ecf81ca24483 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1735 microversion: 2.20 time: 0.159921 May 17 22:15:56.256495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 494/1011] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:56 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:56.988525 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-385dd4f1-91f9-4f65-996a-9400c5cec512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:56.989809 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-385dd4f1-91f9-4f65-996a-9400c5cec512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:56.996740 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-385dd4f1-91f9-4f65-996a-9400c5cec512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:56.997315 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-385dd4f1-91f9-4f65-996a-9400c5cec512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:56.998206 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-385dd4f1-91f9-4f65-996a-9400c5cec512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:56.998747 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-385dd4f1-91f9-4f65-996a-9400c5cec512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:57.274090 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e3c29603-71b8-49af-9667-815712b48c6a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:57.275420 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e3c29603-71b8-49af-9667-815712b48c6a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:57.282457 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3c29603-71b8-49af-9667-815712b48c6a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:57.287738 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3c29603-71b8-49af-9667-815712b48c6a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:57.288643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3c29603-71b8-49af-9667-815712b48c6a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:57.289180 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e3c29603-71b8-49af-9667-815712b48c6a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:57.341209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-385dd4f1-91f9-4f65-996a-9400c5cec512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:57.380015 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-385dd4f1-91f9-4f65-996a-9400c5cec512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1672 microversion: 2.1 time: 0.399329 May 17 22:15:57.384187 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 518/1012] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:56 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1672 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:57.688108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e3c29603-71b8-49af-9667-815712b48c6a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:57.723040 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e3c29603-71b8-49af-9667-815712b48c6a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:57.723040 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e3c29603-71b8-49af-9667-815712b48c6a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:57.723040 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e3c29603-71b8-49af-9667-815712b48c6a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1735 microversion: 2.20 time: 0.437027 May 17 22:15:57.723396 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 495/1013] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:57 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1735 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:58.311373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-c606fcb0-edd5-4504-9edc-462609420ad6 req-4b6a1980-8d03-4998-9469-f9390e14cfef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4d36e2-0f10-4434-ad5d-cc27b81e923e", "name": "network-vif-deleted", "tag": "2c450f46-d2e6-4987-8fa7-2c91fde11f5b"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:15:58.322317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c606fcb0-edd5-4504-9edc-462609420ad6 req-4b6a1980-8d03-4998-9469-f9390e14cfef service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:58.323208 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-c606fcb0-edd5-4504-9edc-462609420ad6 req-4b6a1980-8d03-4998-9469-f9390e14cfef service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:58.340562 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-c606fcb0-edd5-4504-9edc-462609420ad6 req-4b6a1980-8d03-4998-9469-f9390e14cfef service nova] Creating event network-vif-deleted:2c450f46-d2e6-4987-8fa7-2c91fde11f5b for instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e on hv-cinder-83998 May 17 22:15:58.347480 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-c606fcb0-edd5-4504-9edc-462609420ad6 req-4b6a1980-8d03-4998-9469-f9390e14cfef service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039172 May 17 22:15:58.354865 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 519/1014] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:15:58.400499 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e988725e-44af-49a2-91cd-bd09de67cdb8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:58.401840 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e988725e-44af-49a2-91cd-bd09de67cdb8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:58.415791 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e988725e-44af-49a2-91cd-bd09de67cdb8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:58.420788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e988725e-44af-49a2-91cd-bd09de67cdb8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:58.420788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e988725e-44af-49a2-91cd-bd09de67cdb8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:58.420788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e988725e-44af-49a2-91cd-bd09de67cdb8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:58.537136 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e988725e-44af-49a2-91cd-bd09de67cdb8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626cf3ce22fd4d019022b52e21916a2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9b23322633464f975b94a2144fa300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:58.547454 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e988725e-44af-49a2-91cd-bd09de67cdb8 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 200 len: 1605 microversion: 2.1 time: 0.151441 May 17 22:15:58.548193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 496/1015] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:58 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 1605 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:15:58.734324 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7c5fd0bf-ffee-44e8-9648-cb38d282c259 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:58.738065 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7c5fd0bf-ffee-44e8-9648-cb38d282c259 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:58.750982 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c5fd0bf-ffee-44e8-9648-cb38d282c259 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:58.751712 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c5fd0bf-ffee-44e8-9648-cb38d282c259 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:58.752683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c5fd0bf-ffee-44e8-9648-cb38d282c259 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:58.753460 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c5fd0bf-ffee-44e8-9648-cb38d282c259 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:58.936228 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c5fd0bf-ffee-44e8-9648-cb38d282c259 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:58.947940 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c5fd0bf-ffee-44e8-9648-cb38d282c259 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:58.950604 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c5fd0bf-ffee-44e8-9648-cb38d282c259 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:15:58.952518 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7c5fd0bf-ffee-44e8-9648-cb38d282c259 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1735 microversion: 2.20 time: 0.222471 May 17 22:15:58.953671 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 520/1016] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:58 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:15:59.578007 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8f323709-1628-4c9e-b637-abcefd5f8e56 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:59.578762 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8f323709-1628-4c9e-b637-abcefd5f8e56 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:59.587050 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f323709-1628-4c9e-b637-abcefd5f8e56 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:59.588086 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f323709-1628-4c9e-b637-abcefd5f8e56 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:59.589128 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f323709-1628-4c9e-b637-abcefd5f8e56 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:59.589832 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f323709-1628-4c9e-b637-abcefd5f8e56 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:59.606454 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-8f323709-1628-4c9e-b637-abcefd5f8e56 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] HTTP exception thrown: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8f323709-1628-4c9e-b637-abcefd5f8e56 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Request method failure captured: May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e HTTP/1.1 May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0JcJQZNanKAInsUwM8DUyQL8POChFnPtKN-V6H8MHRq_7JmttrczJ_x53edlliGpPmXKvyfoEAYdcrruIgm53o2KEoALfKJXGQlqKa4LgmnQPasgtfNvnffh-1IV5aKcHaIftIeBmcPqu8z4VYqwW6HH8lg58nuSCNN4tyAUDrmyI May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: fe9b23322633464f975b94a2144fa300 May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-AttachVolumeTestJSON-1253707150 May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:15:59.701195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:15:59.703342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fe9b23322633464f975b94a2144fa300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_fe9b23322633464f975b94a2144fa300", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/fe9b23322633464f975b94a2144fa300"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fe9b23322633464f975b94a2144fa300"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:15:59.703342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-AttachVolumeTestJSON-1253707150 May 17 22:15:59.703342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: fe9b23322633464f975b94a2144fa300 May 17 22:15:59.703342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1253707150 May 17 22:15:59.703342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-AttachVolumeTestJSON-1253707150-project May 17 22:15:59.703342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:15:59.703342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:15:59.703342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 626cf3ce22fd4d019022b52e21916a2f May 17 22:15:59.703342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-AttachVolumeTestJSON-1253707150-project May 17 22:15:59.703342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:15:59.703342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:15:59.703342 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '8d4d36e2-0f10-4434-ad5d-cc27b81e923e'} May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:15:59.704546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:15:59.706604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:15:59.708020 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8f323709-1628-4c9e-b637-abcefd5f8e56 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Returning 404 to user: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:15:59.708020 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8f323709-1628-4c9e-b637-abcefd5f8e56 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 404 len: 111 microversion: 2.1 time: 0.048547 May 17 22:15:59.708020 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 497/1017] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:15:59 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:15:59.709319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1b270feb-1e71-42a1-be02-c59fcfab0c20 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '.version_select at 0x7f09f21a4430>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:59.972701 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a9fd5869-7f0f-4742-8437-3c068e706b61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:15:59.973321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a9fd5869-7f0f-4742-8437-3c068e706b61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:15:59.979310 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a9fd5869-7f0f-4742-8437-3c068e706b61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:59.981389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a9fd5869-7f0f-4742-8437-3c068e706b61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:15:59.981389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a9fd5869-7f0f-4742-8437-3c068e706b61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:15:59.981389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a9fd5869-7f0f-4742-8437-3c068e706b61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:00.049241 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1b270feb-1e71-42a1-be02-c59fcfab0c20 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-791898968" status: 202 len: 0 microversion: 2.1 time: 0.335244 May 17 22:16:00.049241 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 521/1018] 10.222.0.24 () {58 vars in 1217 bytes} [Tue May 17 22:15:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-791898968 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 22:16:00.390640 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a9fd5869-7f0f-4742-8437-3c068e706b61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:00.403595 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a9fd5869-7f0f-4742-8437-3c068e706b61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:00.405358 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a9fd5869-7f0f-4742-8437-3c068e706b61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:00.406653 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a9fd5869-7f0f-4742-8437-3c068e706b61 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1735 microversion: 2.20 time: 0.438685 May 17 22:16:00.407671 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 498/1019] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:15:59 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1735 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:16:01.425505 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ebfe8e8f-bdc6-4ba2-bc60-c94c56522e00 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:01.426890 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ebfe8e8f-bdc6-4ba2-bc60-c94c56522e00 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:01.433745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ebfe8e8f-bdc6-4ba2-bc60-c94c56522e00 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:01.434192 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ebfe8e8f-bdc6-4ba2-bc60-c94c56522e00 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:01.435934 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ebfe8e8f-bdc6-4ba2-bc60-c94c56522e00 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:01.435934 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ebfe8e8f-bdc6-4ba2-bc60-c94c56522e00 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:01.569808 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ebfe8e8f-bdc6-4ba2-bc60-c94c56522e00 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:01.578188 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ebfe8e8f-bdc6-4ba2-bc60-c94c56522e00 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:01.579714 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ebfe8e8f-bdc6-4ba2-bc60-c94c56522e00 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:01.581172 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ebfe8e8f-bdc6-4ba2-bc60-c94c56522e00 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1735 microversion: 2.20 time: 0.160573 May 17 22:16:01.582070 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 522/1020] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:01 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:02.600341 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b92cc733-c7d3-4c42-abf8-a4580768614b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:02.601450 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b92cc733-c7d3-4c42-abf8-a4580768614b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:02.607332 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b92cc733-c7d3-4c42-abf8-a4580768614b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:02.607782 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b92cc733-c7d3-4c42-abf8-a4580768614b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:02.608561 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b92cc733-c7d3-4c42-abf8-a4580768614b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:02.608999 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b92cc733-c7d3-4c42-abf8-a4580768614b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:02.739939 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b92cc733-c7d3-4c42-abf8-a4580768614b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:02.747916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b92cc733-c7d3-4c42-abf8-a4580768614b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:02.749401 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b92cc733-c7d3-4c42-abf8-a4580768614b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:02.750554 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b92cc733-c7d3-4c42-abf8-a4580768614b tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1717 microversion: 2.20 time: 0.154840 May 17 22:16:02.751098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 499/1021] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:02 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:03.574457 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-080fe1fe-12d6-40c2-bac9-9176ff27db39 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:03.574937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-080fe1fe-12d6-40c2-bac9-9176ff27db39 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:03.581751 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-080fe1fe-12d6-40c2-bac9-9176ff27db39 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:03.582205 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-080fe1fe-12d6-40c2-bac9-9176ff27db39 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:03.582980 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-080fe1fe-12d6-40c2-bac9-9176ff27db39 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:03.583434 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-080fe1fe-12d6-40c2-bac9-9176ff27db39 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:03.600283 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-080fe1fe-12d6-40c2-bac9-9176ff27db39 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] HTTP exception thrown: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-080fe1fe-12d6-40c2-bac9-9176ff27db39 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Request method failure captured: May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: DELETE /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e HTTP/1.1 May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0JcJQZNanKAInsUwM8DUyQL8POChFnPtKN-V6H8MHRq_7JmttrczJ_x53edlliGpPmXKvyfoEAYdcrruIgm53o2KEoALfKJXGQlqKa4LgmnQPasgtfNvnffh-1IV5aKcHaIftIeBmcPqu8z4VYqwW6HH8lg58nuSCNN4tyAUDrmyI May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: fe9b23322633464f975b94a2144fa300 May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeTestJSON-1253707150 May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:16:03.601941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:16:03.603627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fe9b23322633464f975b94a2144fa300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_fe9b23322633464f975b94a2144fa300", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/fe9b23322633464f975b94a2144fa300"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fe9b23322633464f975b94a2144fa300"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:03.603627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeTestJSON-1253707150 May 17 22:16:03.603627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: fe9b23322633464f975b94a2144fa300 May 17 22:16:03.603627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1253707150 May 17 22:16:03.603627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeTestJSON-1253707150-project May 17 22:16:03.603627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:16:03.603627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:16:03.603627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 626cf3ce22fd4d019022b52e21916a2f May 17 22:16:03.603627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeTestJSON-1253707150-project May 17 22:16:03.603627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:16:03.603627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:16:03.603627 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '8d4d36e2-0f10-4434-ad5d-cc27b81e923e'} May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:03.607405 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:16:03.608907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:03.610396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-080fe1fe-12d6-40c2-bac9-9176ff27db39 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Returning 404 to user: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:03.610396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-080fe1fe-12d6-40c2-bac9-9176ff27db39 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 404 len: 111 microversion: 2.1 time: 0.032729 May 17 22:16:03.610396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 523/1022] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:16:03 2022] DELETE /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:03.611841 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-203b933e-1a87-4e66-bd65-abbcb2675636 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:03.613421 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-203b933e-1a87-4e66-bd65-abbcb2675636 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 8d4d36e2-0f10-4434-ad5d-cc27b81e923e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:03.619671 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-203b933e-1a87-4e66-bd65-abbcb2675636 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:03.659988 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-203b933e-1a87-4e66-bd65-abbcb2675636 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:03.659988 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-203b933e-1a87-4e66-bd65-abbcb2675636 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:03.659988 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-203b933e-1a87-4e66-bd65-abbcb2675636 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:03.659988 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-203b933e-1a87-4e66-bd65-abbcb2675636 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] HTTP exception thrown: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:16:03.659988 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-203b933e-1a87-4e66-bd65-abbcb2675636 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Request method failure captured: May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e HTTP/1.1 May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0JcJQZNanKAInsUwM8DUyQL8POChFnPtKN-V6H8MHRq_7JmttrczJ_x53edlliGpPmXKvyfoEAYdcrruIgm53o2KEoALfKJXGQlqKa4LgmnQPasgtfNvnffh-1IV5aKcHaIftIeBmcPqu8z4VYqwW6HH8lg58nuSCNN4tyAUDrmyI May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: fe9b23322633464f975b94a2144fa300 May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-AttachVolumeTestJSON-1253707150 May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:16:03.660487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:16:03.661983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fe9b23322633464f975b94a2144fa300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_fe9b23322633464f975b94a2144fa300", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/fe9b23322633464f975b94a2144fa300"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fe9b23322633464f975b94a2144fa300"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:03.661983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-AttachVolumeTestJSON-1253707150 May 17 22:16:03.661983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: fe9b23322633464f975b94a2144fa300 May 17 22:16:03.661983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1253707150 May 17 22:16:03.661983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-AttachVolumeTestJSON-1253707150-project May 17 22:16:03.661983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:16:03.661983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:16:03.661983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 626cf3ce22fd4d019022b52e21916a2f May 17 22:16:03.661983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-AttachVolumeTestJSON-1253707150-project May 17 22:16:03.661983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:16:03.661983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:16:03.661983 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '8d4d36e2-0f10-4434-ad5d-cc27b81e923e'} May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:03.662833 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. May 17 22:16:03.664357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:03.665815 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-203b933e-1a87-4e66-bd65-abbcb2675636 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Returning 404 to user: Instance 8d4d36e2-0f10-4434-ad5d-cc27b81e923e could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:03.665815 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-203b933e-1a87-4e66-bd65-abbcb2675636 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e" status: 404 len: 111 microversion: 2.1 time: 0.031295 May 17 22:16:03.665815 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 500/1023] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:16:03 2022] GET /compute/v2.1/servers/8d4d36e2-0f10-4434-ad5d-cc27b81e923e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:03.770258 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-59935761-5d74-419b-8c25-ad32b0e7b0da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:03.770846 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-59935761-5d74-419b-8c25-ad32b0e7b0da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:03.776741 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59935761-5d74-419b-8c25-ad32b0e7b0da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:03.777185 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59935761-5d74-419b-8c25-ad32b0e7b0da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:03.777940 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59935761-5d74-419b-8c25-ad32b0e7b0da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:03.778413 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-59935761-5d74-419b-8c25-ad32b0e7b0da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:03.915030 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-59935761-5d74-419b-8c25-ad32b0e7b0da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:03.924733 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-59935761-5d74-419b-8c25-ad32b0e7b0da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:03.926400 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-59935761-5d74-419b-8c25-ad32b0e7b0da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:03.927631 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-59935761-5d74-419b-8c25-ad32b0e7b0da tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1717 microversion: 2.20 time: 0.162090 May 17 22:16:03.928382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 524/1024] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:03 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:04.946780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8bd3c058-ea58-4d98-a458-6b89ce4cb83d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:04.947431 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8bd3c058-ea58-4d98-a458-6b89ce4cb83d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:04.954168 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8bd3c058-ea58-4d98-a458-6b89ce4cb83d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:04.954844 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8bd3c058-ea58-4d98-a458-6b89ce4cb83d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:04.955693 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8bd3c058-ea58-4d98-a458-6b89ce4cb83d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:04.956145 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8bd3c058-ea58-4d98-a458-6b89ce4cb83d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:04.976033 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-627e06f7-58cf-40d3-8074-043ad9e4f315 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:04.976550 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-627e06f7-58cf-40d3-8074-043ad9e4f315 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:04.982863 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-627e06f7-58cf-40d3-8074-043ad9e4f315 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:04.983344 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-627e06f7-58cf-40d3-8074-043ad9e4f315 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:04.984123 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-627e06f7-58cf-40d3-8074-043ad9e4f315 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:04.984553 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-627e06f7-58cf-40d3-8074-043ad9e4f315 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:04.998909 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-627e06f7-58cf-40d3-8074-043ad9e4f315 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] HTTP exception thrown: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-627e06f7-58cf-40d3-8074-043ad9e4f315 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Request method failure captured: May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: DELETE /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee HTTP/1.1 May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0JcJQZNanKAInsUwM8DUyQL8POChFnPtKN-V6H8MHRq_7JmttrczJ_x53edlliGpPmXKvyfoEAYdcrruIgm53o2KEoALfKJXGQlqKa4LgmnQPasgtfNvnffh-1IV5aKcHaIftIeBmcPqu8z4VYqwW6HH8lg58nuSCNN4tyAUDrmyI May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: fe9b23322633464f975b94a2144fa300 May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeTestJSON-1253707150 May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:16:05.000715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:16:05.002396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fe9b23322633464f975b94a2144fa300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_fe9b23322633464f975b94a2144fa300", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/fe9b23322633464f975b94a2144fa300"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fe9b23322633464f975b94a2144fa300"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:05.002396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeTestJSON-1253707150 May 17 22:16:05.002396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: fe9b23322633464f975b94a2144fa300 May 17 22:16:05.002396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1253707150 May 17 22:16:05.002396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeTestJSON-1253707150-project May 17 22:16:05.002396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:16:05.002396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:16:05.002396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 626cf3ce22fd4d019022b52e21916a2f May 17 22:16:05.002396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeTestJSON-1253707150-project May 17 22:16:05.002396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:16:05.002396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:16:05.002396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '65e6e64e-c18e-4856-9a95-0833c10482ee'} May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:05.003777 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:16:05.005936 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:05.007558 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-627e06f7-58cf-40d3-8074-043ad9e4f315 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Returning 404 to user: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:05.007558 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-627e06f7-58cf-40d3-8074-043ad9e4f315 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "DELETE /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 404 len: 111 microversion: 2.1 time: 0.030841 May 17 22:16:05.007558 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 525/1025] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:16:04 2022] DELETE /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 22:16:05.011391 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-38efce3d-841f-4b8f-8604-a7b9104f5512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:05.011999 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-38efce3d-841f-4b8f-8604-a7b9104f5512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] [instance: 65e6e64e-c18e-4856-9a95-0833c10482ee] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:05.017798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38efce3d-841f-4b8f-8604-a7b9104f5512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:05.018373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38efce3d-841f-4b8f-8604-a7b9104f5512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:05.019314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38efce3d-841f-4b8f-8604-a7b9104f5512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:05.019750 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-38efce3d-841f-4b8f-8604-a7b9104f5512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:05.032968 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-38efce3d-841f-4b8f-8604-a7b9104f5512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] HTTP exception thrown: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-38efce3d-841f-4b8f-8604-a7b9104f5512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Request method failure captured: May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee HTTP/1.1 May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0JcJQZNanKAInsUwM8DUyQL8POChFnPtKN-V6H8MHRq_7JmttrczJ_x53edlliGpPmXKvyfoEAYdcrruIgm53o2KEoALfKJXGQlqKa4LgmnQPasgtfNvnffh-1IV5aKcHaIftIeBmcPqu8z4VYqwW6HH8lg58nuSCNN4tyAUDrmyI May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: fe9b23322633464f975b94a2144fa300 May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeTestJSON-1253707150 May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:16:05.035089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:16:05.036818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fe9b23322633464f975b94a2144fa300"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_fe9b23322633464f975b94a2144fa300", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/fe9b23322633464f975b94a2144fa300"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/fe9b23322633464f975b94a2144fa300"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:05.036818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeTestJSON-1253707150 May 17 22:16:05.036818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: fe9b23322633464f975b94a2144fa300 May 17 22:16:05.036818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1253707150 May 17 22:16:05.036818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeTestJSON-1253707150-project May 17 22:16:05.036818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:16:05.036818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:16:05.036818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 626cf3ce22fd4d019022b52e21916a2f May 17 22:16:05.036818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeTestJSON-1253707150-project May 17 22:16:05.036818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:16:05.036818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:16:05.036818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '65e6e64e-c18e-4856-9a95-0833c10482ee'} May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:05.038190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. May 17 22:16:05.039775 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:05.042119 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-38efce3d-841f-4b8f-8604-a7b9104f5512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] Returning 404 to user: Instance 65e6e64e-c18e-4856-9a95-0833c10482ee could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:05.042119 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-38efce3d-841f-4b8f-8604-a7b9104f5512 tempest-AttachVolumeTestJSON-1253707150 tempest-AttachVolumeTestJSON-1253707150-project] 10.222.0.24 "GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee" status: 404 len: 111 microversion: 2.1 time: 0.029075 May 17 22:16:05.042119 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 526/1026] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:16:05 2022] GET /compute/v2.1/servers/65e6e64e-c18e-4856-9a95-0833c10482ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 22:16:05.096004 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8bd3c058-ea58-4d98-a458-6b89ce4cb83d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:05.104276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8bd3c058-ea58-4d98-a458-6b89ce4cb83d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:05.105761 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8bd3c058-ea58-4d98-a458-6b89ce4cb83d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:05.106956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8bd3c058-ea58-4d98-a458-6b89ce4cb83d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1720 microversion: 2.20 time: 0.164771 May 17 22:16:05.107569 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 501/1027] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:04 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:05.125280 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fc4fd84d-5ce0-4256-babc-7b1ceac20e0f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42932941-8ad1-4884-b1b6-4060f16c33f0"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:16:05.126336 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fc4fd84d-5ce0-4256-babc-7b1ceac20e0f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:05.132396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc4fd84d-5ce0-4256-babc-7b1ceac20e0f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:05.132850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc4fd84d-5ce0-4256-babc-7b1ceac20e0f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:05.133621 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc4fd84d-5ce0-4256-babc-7b1ceac20e0f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:05.134061 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fc4fd84d-5ce0-4256-babc-7b1ceac20e0f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:06.067546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-58f4b4be-075b-438b-968e-b1d77b7ed7e1 req-98266119-f89d-49e3-9366-c5125aefe540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c", "name": "network-vif-unplugged", "status": "completed", "tag": "01f9ff90-5b71-4555-bb92-f5d36e9518eb"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:16:06.076091 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-58f4b4be-075b-438b-968e-b1d77b7ed7e1 req-98266119-f89d-49e3-9366-c5125aefe540 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:06.076706 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-58f4b4be-075b-438b-968e-b1d77b7ed7e1 req-98266119-f89d-49e3-9366-c5125aefe540 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:06.087961 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.compute.server_external_events [req-58f4b4be-075b-438b-968e-b1d77b7ed7e1 req-98266119-f89d-49e3-9366-c5125aefe540 service nova] Unable to find a host for instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c. Dropping event network-vif-unplugged {{(pid=117594) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 17 22:16:06.088840 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-58f4b4be-075b-438b-968e-b1d77b7ed7e1 req-98266119-f89d-49e3-9366-c5125aefe540 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026556 May 17 22:16:06.089553 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 502/1028] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 17 22:16:06.204663 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fc4fd84d-5ce0-4256-babc-7b1ceac20e0f tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "POST /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.083209 May 17 22:16:06.214614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 527/1029] 10.222.0.24 () {62 vars in 1363 bytes} [Tue May 17 22:16:05 2022] POST /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/os-volume_attachments => generated 188 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 22:16:06.382807 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-152f8eb8-fb06-43d7-b60e-eb419c0ea851 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:06.383614 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-152f8eb8-fb06-43d7-b60e-eb419c0ea851 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:06.390091 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-152f8eb8-fb06-43d7-b60e-eb419c0ea851 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:06.390593 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-152f8eb8-fb06-43d7-b60e-eb419c0ea851 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:06.393802 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-152f8eb8-fb06-43d7-b60e-eb419c0ea851 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:06.394259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-152f8eb8-fb06-43d7-b60e-eb419c0ea851 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:06.999429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-152f8eb8-fb06-43d7-b60e-eb419c0ea851 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/os-volume_attachments/42932941-8ad1-4884-b1b6-4060f16c33f0" status: 202 len: 0 microversion: 2.20 time: 0.620682 May 17 22:16:07.000585 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 503/1030] 10.222.0.24 () {60 vars in 1456 bytes} [Tue May 17 22:16:06 2022] DELETE /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/os-volume_attachments/42932941-8ad1-4884-b1b6-4060f16c33f0 => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 22:16:07.083630 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-954570eb-d502-4ed3-9464-759dbf993d6e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:16:07.084459 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-954570eb-d502-4ed3-9464-759dbf993d6e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:07.091623 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-954570eb-d502-4ed3-9464-759dbf993d6e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:07.092318 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-954570eb-d502-4ed3-9464-759dbf993d6e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:07.093145 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-954570eb-d502-4ed3-9464-759dbf993d6e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:07.093746 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-954570eb-d502-4ed3-9464-759dbf993d6e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:07.364568 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-954570eb-d502-4ed3-9464-759dbf993d6e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "POST /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/action" status: 202 len: 0 microversion: 2.20 time: 0.285248 May 17 22:16:07.366543 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 528/1031] 10.222.0.24 () {62 vars in 1318 bytes} [Tue May 17 22:16:07 2022] POST /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 22:16:07.377375 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-07603a3f-449f-414e-9ac9-e94c81381032 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:07.380858 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-07603a3f-449f-414e-9ac9-e94c81381032 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:07.388437 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07603a3f-449f-414e-9ac9-e94c81381032 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:07.388985 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07603a3f-449f-414e-9ac9-e94c81381032 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:07.389870 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07603a3f-449f-414e-9ac9-e94c81381032 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:07.390532 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-07603a3f-449f-414e-9ac9-e94c81381032 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:07.558627 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-07603a3f-449f-414e-9ac9-e94c81381032 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:07.569610 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-07603a3f-449f-414e-9ac9-e94c81381032 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:07.571742 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-07603a3f-449f-414e-9ac9-e94c81381032 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:07.573066 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-07603a3f-449f-414e-9ac9-e94c81381032 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1668 microversion: 2.20 time: 0.201998 May 17 22:16:07.574442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 504/1032] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:07 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1668 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:07.847877 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4d5f29c0-0690-4b67-9abb-c9618ed185cf tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:07.848431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4d5f29c0-0690-4b67-9abb-c9618ed185cf tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:07.854570 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4d5f29c0-0690-4b67-9abb-c9618ed185cf tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:07.855195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4d5f29c0-0690-4b67-9abb-c9618ed185cf tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:07.855971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4d5f29c0-0690-4b67-9abb-c9618ed185cf tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:07.856426 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4d5f29c0-0690-4b67-9abb-c9618ed185cf tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:07.880128 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4d5f29c0-0690-4b67-9abb-c9618ed185cf tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/ips" status: 200 len: 150 microversion: 2.1 time: 0.036742 May 17 22:16:07.881010 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 529/1033] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 17 22:16:07 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:08.596605 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5f6b9909-ff66-481b-9128-f408371baf8e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:08.596605 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5f6b9909-ff66-481b-9128-f408371baf8e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:08.606668 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f6b9909-ff66-481b-9128-f408371baf8e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:08.607357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f6b9909-ff66-481b-9128-f408371baf8e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:08.608906 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f6b9909-ff66-481b-9128-f408371baf8e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:08.609521 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f6b9909-ff66-481b-9128-f408371baf8e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:08.798657 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5f6b9909-ff66-481b-9128-f408371baf8e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:08.806513 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5f6b9909-ff66-481b-9128-f408371baf8e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:08.808034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5f6b9909-ff66-481b-9128-f408371baf8e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:08.809243 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5f6b9909-ff66-481b-9128-f408371baf8e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1668 microversion: 2.20 time: 0.217662 May 17 22:16:08.809801 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 505/1034] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:08 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1668 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:09.716461 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ad217dbe-c148-46a5-b045-70265c2a906f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6685260-ad10-4fb8-9fd5-c3f6909a057a"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:16:09.716461 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ad217dbe-c148-46a5-b045-70265c2a906f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:09.728025 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad217dbe-c148-46a5-b045-70265c2a906f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:09.728741 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad217dbe-c148-46a5-b045-70265c2a906f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:09.729717 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad217dbe-c148-46a5-b045-70265c2a906f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:09.730505 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad217dbe-c148-46a5-b045-70265c2a906f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:09.831978 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-df5c30a6-834f-4fbe-b30f-f5e244ba8cca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:09.834536 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-df5c30a6-834f-4fbe-b30f-f5e244ba8cca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:09.845374 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df5c30a6-834f-4fbe-b30f-f5e244ba8cca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:09.845916 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df5c30a6-834f-4fbe-b30f-f5e244ba8cca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:09.847566 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df5c30a6-834f-4fbe-b30f-f5e244ba8cca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:09.848069 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-df5c30a6-834f-4fbe-b30f-f5e244ba8cca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:10.027434 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-df5c30a6-834f-4fbe-b30f-f5e244ba8cca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:10.039141 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-df5c30a6-834f-4fbe-b30f-f5e244ba8cca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:10.040554 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-df5c30a6-834f-4fbe-b30f-f5e244ba8cca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:10.041838 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-df5c30a6-834f-4fbe-b30f-f5e244ba8cca tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.217520 May 17 22:16:10.042521 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 506/1035] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:09 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:10.551217 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ad217dbe-c148-46a5-b045-70265c2a906f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "POST /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840351 May 17 22:16:10.551829 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 530/1036] 10.222.0.24 () {60 vars in 1322 bytes} [Tue May 17 22:16:09 2022] POST /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/os-volume_attachments => generated 194 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:11.069025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-37e13bdf-fa3d-4d18-9f6d-fdb14e62fff1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:11.073235 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-37e13bdf-fa3d-4d18-9f6d-fdb14e62fff1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:11.084332 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-37e13bdf-fa3d-4d18-9f6d-fdb14e62fff1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:11.085311 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-37e13bdf-fa3d-4d18-9f6d-fdb14e62fff1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:11.086362 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-37e13bdf-fa3d-4d18-9f6d-fdb14e62fff1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:11.087022 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-37e13bdf-fa3d-4d18-9f6d-fdb14e62fff1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:11.346844 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-37e13bdf-fa3d-4d18-9f6d-fdb14e62fff1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:11.361192 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-37e13bdf-fa3d-4d18-9f6d-fdb14e62fff1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:11.363011 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-37e13bdf-fa3d-4d18-9f6d-fdb14e62fff1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:11.366100 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-37e13bdf-fa3d-4d18-9f6d-fdb14e62fff1 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.302296 May 17 22:16:11.380249 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 507/1037] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:11 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:12.076478 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2f9606d7-ae7a-455e-bbae-2e5dd2c8fea3 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Action: 'create', calling method: .version_select at 0x7f09f21569d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1190443892"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:16:12.390374 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dff0eb55-0e23-4178-894d-35c608b4a42a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:12.391909 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dff0eb55-0e23-4178-894d-35c608b4a42a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:12.401485 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dff0eb55-0e23-4178-894d-35c608b4a42a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:12.403089 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dff0eb55-0e23-4178-894d-35c608b4a42a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:12.407581 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dff0eb55-0e23-4178-894d-35c608b4a42a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:12.408102 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dff0eb55-0e23-4178-894d-35c608b4a42a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:12.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dff0eb55-0e23-4178-894d-35c608b4a42a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:12.586688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dff0eb55-0e23-4178-894d-35c608b4a42a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:12.588236 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dff0eb55-0e23-4178-894d-35c608b4a42a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:12.589598 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dff0eb55-0e23-4178-894d-35c608b4a42a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.203447 May 17 22:16:12.592777 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 508/1038] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:12 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:12.871534 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2f9606d7-ae7a-455e-bbae-2e5dd2c8fea3 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.145959 May 17 22:16:12.872268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 531/1039] 10.222.0.24 () {60 vars in 1154 bytes} [Tue May 17 22:16:11 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1148 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 17 22:16:12.886952 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-16303d9e-323f-4257-968c-263ba8288789 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f204ed30>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:12.949657 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-16303d9e-323f-4257-968c-263ba8288789 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2" status: 200 len: 345 microversion: 2.1 time: 0.062612 May 17 22:16:12.949657 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 509/1040] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:16:12 2022] GET /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:13.608631 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0b2440ee-f114-4260-9394-cf353309f4d5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:13.609972 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0b2440ee-f114-4260-9394-cf353309f4d5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:13.617337 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0b2440ee-f114-4260-9394-cf353309f4d5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:13.617975 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0b2440ee-f114-4260-9394-cf353309f4d5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:13.619379 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0b2440ee-f114-4260-9394-cf353309f4d5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:13.620139 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0b2440ee-f114-4260-9394-cf353309f4d5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:13.776843 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0b2440ee-f114-4260-9394-cf353309f4d5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:13.785991 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0b2440ee-f114-4260-9394-cf353309f4d5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:13.787522 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0b2440ee-f114-4260-9394-cf353309f4d5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:13.788700 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0b2440ee-f114-4260-9394-cf353309f4d5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.184752 May 17 22:16:13.789289 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 532/1041] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:13 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:16:13.958014 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e80323d9-f815-4138-a1f8-da92db6fbf04 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f2062f70>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:14.008013 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e80323d9-f815-4138-a1f8-da92db6fbf04 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2" status: 200 len: 346 microversion: 2.1 time: 0.055694 May 17 22:16:14.009247 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 510/1042] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:16:13 2022] GET /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2 => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:14.026743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-dd1d4ad7-600e-48e5-a5c5-9b28c8475720 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Action: 'create', calling method: .version_select at 0x7f09f218b040>, body: {"snapshot": {"volume_id": "36e32b12-7ca0-4b02-b689-38e360cdcfd2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1222541145"}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:16:14.574235 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-dd1d4ad7-600e-48e5-a5c5-9b28c8475720 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.557886 May 17 22:16:14.579753 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 533/1043] 10.222.0.24 () {60 vars in 1161 bytes} [Tue May 17 22:16:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:16:14.597114 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e403afbf-5529-446e-a433-b135ac6b1e62 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f20a6160>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:14.643826 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e403afbf-5529-446e-a433-b135ac6b1e62 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027" status: 200 len: 287 microversion: 2.1 time: 0.061713 May 17 22:16:14.644947 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 511/1044] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 17 22:16:14 2022] GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:14.654527 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7436bdba-9c68-4596-a8a6-8fb65a33fcb2 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f2133790>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:14.692544 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7436bdba-9c68-4596-a8a6-8fb65a33fcb2 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.041694 May 17 22:16:14.693106 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 534/1045] 10.222.0.24 () {58 vars in 1139 bytes} [Tue May 17 22:16:14 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:14.704919 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-79112f42-d5ff-4798-87e4-aca83c0f2def tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f20a6e50>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:14.745269 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-79112f42-d5ff-4798-87e4-aca83c0f2def tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027" status: 200 len: 287 microversion: 2.1 time: 0.045915 May 17 22:16:14.745835 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 512/1046] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 17 22:16:14 2022] GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:14.807596 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-32133316-4e2b-423d-8751-dc0236fd51c2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:14.808214 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-32133316-4e2b-423d-8751-dc0236fd51c2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:14.815902 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32133316-4e2b-423d-8751-dc0236fd51c2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:14.816441 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32133316-4e2b-423d-8751-dc0236fd51c2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:14.817236 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32133316-4e2b-423d-8751-dc0236fd51c2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:14.817672 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-32133316-4e2b-423d-8751-dc0236fd51c2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:14.972193 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-32133316-4e2b-423d-8751-dc0236fd51c2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:14.980885 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-32133316-4e2b-423d-8751-dc0236fd51c2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:14.983418 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-32133316-4e2b-423d-8751-dc0236fd51c2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:14.984851 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-32133316-4e2b-423d-8751-dc0236fd51c2 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.182389 May 17 22:16:14.985555 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 535/1047] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:14 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:16:15.758784 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-26312f2b-e951-4960-8eb1-585d58070ce6 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f2175940>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:15.788368 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-26312f2b-e951-4960-8eb1-585d58070ce6 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027" status: 200 len: 287 microversion: 2.1 time: 0.033844 May 17 22:16:15.789021 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 513/1048] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 17 22:16:15 2022] GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:16:16.005322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-84f4c2ee-51e1-4577-948b-84aa5f74852e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:16.005939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-84f4c2ee-51e1-4577-948b-84aa5f74852e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:16.015907 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84f4c2ee-51e1-4577-948b-84aa5f74852e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:16.017068 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84f4c2ee-51e1-4577-948b-84aa5f74852e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:16.020877 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84f4c2ee-51e1-4577-948b-84aa5f74852e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:16.021516 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-84f4c2ee-51e1-4577-948b-84aa5f74852e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:16.186516 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-84f4c2ee-51e1-4577-948b-84aa5f74852e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:16.195540 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-84f4c2ee-51e1-4577-948b-84aa5f74852e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:16.197061 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-84f4c2ee-51e1-4577-948b-84aa5f74852e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:16.198286 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-84f4c2ee-51e1-4577-948b-84aa5f74852e tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.197723 May 17 22:16:16.198839 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 536/1049] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:15 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:16.800912 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2aea1a72-40b9-4004-a160-a30028dd3a83 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f2153d30>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:16.839756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2aea1a72-40b9-4004-a160-a30028dd3a83 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027" status: 200 len: 287 microversion: 2.1 time: 0.043317 May 17 22:16:16.840360 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 514/1050] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 17 22:16:16 2022] GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:17.217244 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-11cfe5d2-6bc9-4757-a985-cd00dfba3e74 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:17.219848 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-11cfe5d2-6bc9-4757-a985-cd00dfba3e74 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:17.227854 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11cfe5d2-6bc9-4757-a985-cd00dfba3e74 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:17.228392 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11cfe5d2-6bc9-4757-a985-cd00dfba3e74 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:17.229363 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11cfe5d2-6bc9-4757-a985-cd00dfba3e74 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:17.229998 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11cfe5d2-6bc9-4757-a985-cd00dfba3e74 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:17.367014 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-11cfe5d2-6bc9-4757-a985-cd00dfba3e74 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:17.378333 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-11cfe5d2-6bc9-4757-a985-cd00dfba3e74 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:17.380433 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-11cfe5d2-6bc9-4757-a985-cd00dfba3e74 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:17.382836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-11cfe5d2-6bc9-4757-a985-cd00dfba3e74 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.169635 May 17 22:16:17.399950 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 537/1051] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:17 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:17.855954 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1517acb0-6fbb-4e74-8e47-54b401223c26 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f20a6e50>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:17.887221 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1517acb0-6fbb-4e74-8e47-54b401223c26 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027" status: 200 len: 287 microversion: 2.1 time: 0.034927 May 17 22:16:17.887823 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 515/1052] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 17 22:16:17 2022] GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:18.407903 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-116e1fdd-04e6-4f78-9c10-4a954f562a73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:18.408863 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-116e1fdd-04e6-4f78-9c10-4a954f562a73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:18.420478 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-116e1fdd-04e6-4f78-9c10-4a954f562a73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:18.420836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-116e1fdd-04e6-4f78-9c10-4a954f562a73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:18.424784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-116e1fdd-04e6-4f78-9c10-4a954f562a73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:18.424784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-116e1fdd-04e6-4f78-9c10-4a954f562a73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:18.571623 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-116e1fdd-04e6-4f78-9c10-4a954f562a73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:18.575897 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-116e1fdd-04e6-4f78-9c10-4a954f562a73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:18.577642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-116e1fdd-04e6-4f78-9c10-4a954f562a73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:18.579056 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-116e1fdd-04e6-4f78-9c10-4a954f562a73 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.175608 May 17 22:16:18.579657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 538/1053] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:18 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:18.899654 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a00d5789-11a5-4fc8-b6a5-8ecd5f32b41c tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f1fa84c0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:18.936924 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a00d5789-11a5-4fc8-b6a5-8ecd5f32b41c tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027" status: 200 len: 288 microversion: 2.1 time: 0.041415 May 17 22:16:18.949482 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9b6e075d-217d-44bd-88cc-0346abc6db3a tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f21453a0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:18.953642 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 516/1054] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 17 22:16:18 2022] GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027 => generated 288 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:19.125432 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9b6e075d-217d-44bd-88cc-0346abc6db3a tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027" status: 202 len: 0 microversion: 2.1 time: 0.180621 May 17 22:16:19.135606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 539/1055] 10.222.0.24 () {58 vars in 1253 bytes} [Tue May 17 22:16:18 2022] DELETE /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:16:19.135771 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a2236903-16d5-4c89-aecf-d710890bd32c tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f21b55e0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:19.170295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a2236903-16d5-4c89-aecf-d710890bd32c tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027" status: 200 len: 287 microversion: 2.1 time: 0.034997 May 17 22:16:19.170295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 517/1056] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 17 22:16:19 2022] GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:19.598802 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5814ca94-6dce-4f38-8741-a3d4c4101664 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:19.599507 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5814ca94-6dce-4f38-8741-a3d4c4101664 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:19.605545 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5814ca94-6dce-4f38-8741-a3d4c4101664 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:19.605986 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5814ca94-6dce-4f38-8741-a3d4c4101664 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:19.606743 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5814ca94-6dce-4f38-8741-a3d4c4101664 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:19.607205 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5814ca94-6dce-4f38-8741-a3d4c4101664 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:19.735666 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5814ca94-6dce-4f38-8741-a3d4c4101664 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:19.744509 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5814ca94-6dce-4f38-8741-a3d4c4101664 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:19.746049 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5814ca94-6dce-4f38-8741-a3d4c4101664 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:19.747280 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5814ca94-6dce-4f38-8741-a3d4c4101664 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.153190 May 17 22:16:19.747859 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 540/1057] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:19 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:20.180657 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c339039f-3ebc-4e8b-a0ef-9dfaeab398c2 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f21538b0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:20.205932 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-c339039f-3ebc-4e8b-a0ef-9dfaeab398c2 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] HTTP exception thrown: Snapshot 1e45cae5-ec7a-4c9b-9773-aae5affb9027 could not be found. May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c339039f-3ebc-4e8b-a0ef-9dfaeab398c2 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Request method failure captured: May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027 HTTP/1.1 May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB6r9EoHd0Bt7VSFWQs-xlJLCFpzKxd-hhAQSAC8KFQYymD8YQW9XbkUma0zFBpdSfPqqM2rE53syA0pPS9qSe9v85BlSH2T40Hjnh_8IbEItKdE-hg_OsYeWS6l5S2-Wdcp6UkphHmH33b9xLVhgt__Jw7BmaCnYyt09wyuc-1JIiA May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: f632878ceb5d4bec9437bfbdca61a132 May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1147474520 May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:16:20.214000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f632878ceb5d4bec9437bfbdca61a132"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f632878ceb5d4bec9437bfbdca61a132", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f632878ceb5d4bec9437bfbdca61a132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f632878ceb5d4bec9437bfbdca61a132"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1147474520 May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: f632878ceb5d4bec9437bfbdca61a132 May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1147474520 May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-VolumesSnapshotsTestJSON-1147474520-project May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 417a1ab4ba984b2d927a9ff299bf7280 May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1147474520-project May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Snapshot 1e45cae5-ec7a-4c9b-9773-aae5affb9027 could not be found. May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '1e45cae5-ec7a-4c9b-9773-aae5affb9027'} May 17 22:16:20.215756 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1e45cae5-ec7a-4c9b-9773-aae5affb9027 could not be found. (HTTP 404) (Request-ID: req-743c9565-4078-4abe-81e1-767827028616) May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:20.216795 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 22:16:20.218453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1e45cae5-ec7a-4c9b-9773-aae5affb9027 could not be found. May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 17 22:16:20.220245 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1e45cae5-ec7a-4c9b-9773-aae5affb9027 could not be found. May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1e45cae5-ec7a-4c9b-9773-aae5affb9027 could not be found. May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c339039f-3ebc-4e8b-a0ef-9dfaeab398c2 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Returning 404 to user: Snapshot 1e45cae5-ec7a-4c9b-9773-aae5affb9027 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:20.222620 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c339039f-3ebc-4e8b-a0ef-9dfaeab398c2 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027" status: 404 len: 111 microversion: 2.1 time: 0.039022 May 17 22:16:20.223675 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 518/1058] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 17 22:16:20 2022] GET /compute/v2.1/os-snapshots/1e45cae5-ec7a-4c9b-9773-aae5affb9027 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 22:16:20.224596 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b0094042-9395-4914-8bfe-ad1ec24a00fb tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f20e3af0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:20.417232 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b0094042-9395-4914-8bfe-ad1ec24a00fb tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2" status: 202 len: 0 microversion: 2.1 time: 0.196819 May 17 22:16:20.421158 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 541/1059] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 17 22:16:20 2022] DELETE /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:16:20.428152 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-fe4e4e19-59ae-4953-ae3c-499550860a5f tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f2145ca0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:20.474247 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-fe4e4e19-59ae-4953-ae3c-499550860a5f tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2" status: 200 len: 345 microversion: 2.1 time: 0.049977 May 17 22:16:20.474832 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 519/1060] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:16:20 2022] GET /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:20.766636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-71ebb0a1-c72f-416c-aacd-b96385475d02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:20.767239 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-71ebb0a1-c72f-416c-aacd-b96385475d02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:20.773989 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71ebb0a1-c72f-416c-aacd-b96385475d02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:20.776640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71ebb0a1-c72f-416c-aacd-b96385475d02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:20.776640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71ebb0a1-c72f-416c-aacd-b96385475d02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:20.776640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-71ebb0a1-c72f-416c-aacd-b96385475d02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:20.908462 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-71ebb0a1-c72f-416c-aacd-b96385475d02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:20.916245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-71ebb0a1-c72f-416c-aacd-b96385475d02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:20.917731 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-71ebb0a1-c72f-416c-aacd-b96385475d02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:20.918886 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-71ebb0a1-c72f-416c-aacd-b96385475d02 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.156865 May 17 22:16:20.919475 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 542/1061] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:20 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:21.495294 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-abb2c9c0-bdfc-4399-86f8-c0b31485a1e7 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f1f01dc0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:21.523527 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-abb2c9c0-bdfc-4399-86f8-c0b31485a1e7 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] HTTP exception thrown: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-abb2c9c0-bdfc-4399-86f8-c0b31485a1e7 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Request method failure captured: May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2 HTTP/1.1 May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB6r9EoHd0Bt7VSFWQs-xlJLCFpzKxd-hhAQSAC8KFQYymD8YQW9XbkUma0zFBpdSfPqqM2rE53syA0pPS9qSe9v85BlSH2T40Hjnh_8IbEItKdE-hg_OsYeWS6l5S2-Wdcp6UkphHmH33b9xLVhgt__Jw7BmaCnYyt09wyuc-1JIiA May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: f632878ceb5d4bec9437bfbdca61a132 May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1147474520 May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:16:21.527905 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f632878ceb5d4bec9437bfbdca61a132"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f632878ceb5d4bec9437bfbdca61a132", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f632878ceb5d4bec9437bfbdca61a132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f632878ceb5d4bec9437bfbdca61a132"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1147474520 May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: f632878ceb5d4bec9437bfbdca61a132 May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1147474520 May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-VolumesSnapshotsTestJSON-1147474520-project May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 417a1ab4ba984b2d927a9ff299bf7280 May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1147474520-project May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '36e32b12-7ca0-4b02-b689-38e360cdcfd2'} May 17 22:16:21.529448 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. (HTTP 404) (Request-ID: req-5231eb99-90c9-4851-9616-4c928d90d503) May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:21.530276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 22:16:21.531998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 22:16:21.533199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-abb2c9c0-bdfc-4399-86f8-c0b31485a1e7 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Returning 404 to user: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-abb2c9c0-bdfc-4399-86f8-c0b31485a1e7 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2" status: 404 len: 109 microversion: 2.1 time: 0.039203 May 17 22:16:21.535042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 520/1062] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:16:21 2022] GET /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:21.541911 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4d6d5007-4b37-4371-9e77-489769bdffed tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f2145550>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:21.571937 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-4d6d5007-4b37-4371-9e77-489769bdffed tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] HTTP exception thrown: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4d6d5007-4b37-4371-9e77-489769bdffed tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Request method failure captured: May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: DELETE /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2 HTTP/1.1 May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB6r9EoHd0Bt7VSFWQs-xlJLCFpzKxd-hhAQSAC8KFQYymD8YQW9XbkUma0zFBpdSfPqqM2rE53syA0pPS9qSe9v85BlSH2T40Hjnh_8IbEItKdE-hg_OsYeWS6l5S2-Wdcp6UkphHmH33b9xLVhgt__Jw7BmaCnYyt09wyuc-1JIiA May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: f632878ceb5d4bec9437bfbdca61a132 May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1147474520 May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:16:21.575238 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f632878ceb5d4bec9437bfbdca61a132"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f632878ceb5d4bec9437bfbdca61a132", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f632878ceb5d4bec9437bfbdca61a132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f632878ceb5d4bec9437bfbdca61a132"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1147474520 May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: f632878ceb5d4bec9437bfbdca61a132 May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1147474520 May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-VolumesSnapshotsTestJSON-1147474520-project May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 417a1ab4ba984b2d927a9ff299bf7280 May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1147474520-project May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '36e32b12-7ca0-4b02-b689-38e360cdcfd2'} May 17 22:16:21.576715 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. (HTTP 404) (Request-ID: req-39472a21-07ed-43b3-b663-5263c91ba210) May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:21.577632 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 22:16:21.579293 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 22:16:21.580939 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:21.582342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.582342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.582342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:21.582342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.582342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:21.582342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:21.582342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:21.582342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:21.582342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:21.582342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.582342 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.583158 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8e33052a-c8c3-4dd0-ba8e-cf7aa9215ff5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:21.583260 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4d6d5007-4b37-4371-9e77-489769bdffed tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Returning 404 to user: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:21.583365 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8e33052a-c8c3-4dd0-ba8e-cf7aa9215ff5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:21.583475 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4d6d5007-4b37-4371-9e77-489769bdffed tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2" status: 404 len: 109 microversion: 2.1 time: 0.038590 May 17 22:16:21.583475 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 543/1063] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 17 22:16:21 2022] DELETE /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:21.584867 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-efecb758-3dc8-430f-a4d7-615fb5555187 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Calling method '.version_select at 0x7f09f21fb040>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:21.585798 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e33052a-c8c3-4dd0-ba8e-cf7aa9215ff5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:21.586276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e33052a-c8c3-4dd0-ba8e-cf7aa9215ff5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:21.587050 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e33052a-c8c3-4dd0-ba8e-cf7aa9215ff5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:21.587534 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8e33052a-c8c3-4dd0-ba8e-cf7aa9215ff5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:21.614569 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-efecb758-3dc8-430f-a4d7-615fb5555187 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] HTTP exception thrown: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-efecb758-3dc8-430f-a4d7-615fb5555187 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Request method failure captured: May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2 HTTP/1.1 May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB6r9EoHd0Bt7VSFWQs-xlJLCFpzKxd-hhAQSAC8KFQYymD8YQW9XbkUma0zFBpdSfPqqM2rE53syA0pPS9qSe9v85BlSH2T40Hjnh_8IbEItKdE-hg_OsYeWS6l5S2-Wdcp6UkphHmH33b9xLVhgt__Jw7BmaCnYyt09wyuc-1JIiA May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: f632878ceb5d4bec9437bfbdca61a132 May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1147474520 May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:16:21.616642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f632878ceb5d4bec9437bfbdca61a132"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f632878ceb5d4bec9437bfbdca61a132", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f632878ceb5d4bec9437bfbdca61a132"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f632878ceb5d4bec9437bfbdca61a132"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1147474520 May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: f632878ceb5d4bec9437bfbdca61a132 May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1147474520 May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-VolumesSnapshotsTestJSON-1147474520-project May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 417a1ab4ba984b2d927a9ff299bf7280 May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1147474520-project May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '36e32b12-7ca0-4b02-b689-38e360cdcfd2'} May 17 22:16:21.618039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. (HTTP 404) (Request-ID: req-a7b1ae7d-3acc-42dc-b02d-a6ef7994893f) May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:21.618861 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 22:16:21.620245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 22:16:21.621694 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-efecb758-3dc8-430f-a4d7-615fb5555187 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] Returning 404 to user: Volume 36e32b12-7ca0-4b02-b689-38e360cdcfd2 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-efecb758-3dc8-430f-a4d7-615fb5555187 tempest-VolumesSnapshotsTestJSON-1147474520 tempest-VolumesSnapshotsTestJSON-1147474520-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2" status: 404 len: 109 microversion: 2.1 time: 0.036803 May 17 22:16:21.623042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 544/1064] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:16:21 2022] GET /compute/v2.1/os-volumes/36e32b12-7ca0-4b02-b689-38e360cdcfd2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:21.670949 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-8e33052a-c8c3-4dd0-ba8e-cf7aa9215ff5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lazy-loading 'services' on Instance uuid f3fa9042-8c2f-46bd-8570-97f8e8585216 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:16:21.890715 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8e33052a-c8c3-4dd0-ba8e-cf7aa9215ff5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/os-volume_attachments/b6685260-ad10-4fb8-9fd5-c3f6909a057a" status: 202 len: 0 microversion: 2.1 time: 0.318568 May 17 22:16:21.891647 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 521/1065] 10.222.0.24 () {58 vars in 1415 bytes} [Tue May 17 22:16:21 2022] DELETE /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/os-volume_attachments/b6685260-ad10-4fb8-9fd5-c3f6909a057a => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 22:16:21.900682 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-82a54f55-6703-4343-bf31-daef8260ab0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:21.902346 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-82a54f55-6703-4343-bf31-daef8260ab0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:21.908791 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-82a54f55-6703-4343-bf31-daef8260ab0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:21.909312 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-82a54f55-6703-4343-bf31-daef8260ab0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:21.910160 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-82a54f55-6703-4343-bf31-daef8260ab0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:21.910667 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-82a54f55-6703-4343-bf31-daef8260ab0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:21.941139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-46ad08d8-9dca-47ce-b064-513fc1aef6e7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:21.942292 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-46ad08d8-9dca-47ce-b064-513fc1aef6e7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:21.950124 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-46ad08d8-9dca-47ce-b064-513fc1aef6e7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:21.951276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-46ad08d8-9dca-47ce-b064-513fc1aef6e7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:21.952217 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-46ad08d8-9dca-47ce-b064-513fc1aef6e7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:21.952904 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-46ad08d8-9dca-47ce-b064-513fc1aef6e7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:21.960817 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-82a54f55-6703-4343-bf31-daef8260ab0f tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064655 May 17 22:16:21.962270 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 545/1066] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:16:21 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:22.147190 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-46ad08d8-9dca-47ce-b064-513fc1aef6e7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:22.156507 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-46ad08d8-9dca-47ce-b064-513fc1aef6e7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:22.158379 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-46ad08d8-9dca-47ce-b064-513fc1aef6e7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:22.160547 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-46ad08d8-9dca-47ce-b064-513fc1aef6e7 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.226845 May 17 22:16:22.171045 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 522/1067] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:21 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:16:22.976182 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-94b72d71-5bb5-41a6-9222-aa83f2331351 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:22.977607 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-94b72d71-5bb5-41a6-9222-aa83f2331351 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:22.987605 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-94b72d71-5bb5-41a6-9222-aa83f2331351 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:22.988066 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-94b72d71-5bb5-41a6-9222-aa83f2331351 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:22.988875 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-94b72d71-5bb5-41a6-9222-aa83f2331351 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:22.989291 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-94b72d71-5bb5-41a6-9222-aa83f2331351 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:23.025030 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-94b72d71-5bb5-41a6-9222-aa83f2331351 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054616 May 17 22:16:23.030048 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 546/1068] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:16:22 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:23.186013 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-34c12650-f9d5-440c-a07c-87f6f62caaae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:23.186013 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-34c12650-f9d5-440c-a07c-87f6f62caaae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:23.192481 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34c12650-f9d5-440c-a07c-87f6f62caaae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:23.193177 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34c12650-f9d5-440c-a07c-87f6f62caaae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:23.193978 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34c12650-f9d5-440c-a07c-87f6f62caaae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:23.194649 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-34c12650-f9d5-440c-a07c-87f6f62caaae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:23.332910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-34c12650-f9d5-440c-a07c-87f6f62caaae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:23.340792 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-34c12650-f9d5-440c-a07c-87f6f62caaae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:23.342340 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-34c12650-f9d5-440c-a07c-87f6f62caaae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:23.343512 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-34c12650-f9d5-440c-a07c-87f6f62caaae tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.168421 May 17 22:16:23.344077 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 523/1069] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:23 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:24.038556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ae515f52-a1d0-497d-b4bc-63b183f741c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:24.039511 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ae515f52-a1d0-497d-b4bc-63b183f741c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:24.046152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ae515f52-a1d0-497d-b4bc-63b183f741c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:24.046598 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ae515f52-a1d0-497d-b4bc-63b183f741c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:24.047387 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ae515f52-a1d0-497d-b4bc-63b183f741c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:24.047818 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ae515f52-a1d0-497d-b4bc-63b183f741c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:24.082864 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ae515f52-a1d0-497d-b4bc-63b183f741c3 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048917 May 17 22:16:24.088370 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 547/1070] 10.222.0.24 () {58 vars in 1301 bytes} [Tue May 17 22:16:24 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 22:16:24.213976 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-63185289-4b3f-43c4-8845-8b8958d1b807 req-daafc61d-a2e1-459a-a26f-76a1108685ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c", "name": "network-vif-plugged", "status": "completed", "tag": "01f9ff90-5b71-4555-bb92-f5d36e9518eb"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:16:24.223073 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-63185289-4b3f-43c4-8845-8b8958d1b807 req-daafc61d-a2e1-459a-a26f-76a1108685ca service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:24.223544 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-63185289-4b3f-43c4-8845-8b8958d1b807 req-daafc61d-a2e1-459a-a26f-76a1108685ca service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:24.234321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-63185289-4b3f-43c4-8845-8b8958d1b807 req-daafc61d-a2e1-459a-a26f-76a1108685ca service nova] Creating event network-vif-plugged:01f9ff90-5b71-4555-bb92-f5d36e9518eb for instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c on hv-cinder-83998 May 17 22:16:24.239161 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-63185289-4b3f-43c4-8845-8b8958d1b807 req-daafc61d-a2e1-459a-a26f-76a1108685ca service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028849 May 17 22:16:24.242389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 524/1071] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:24.361774 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fd12fb00-ca8a-4171-81f5-f7c375717458 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:24.362374 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fd12fb00-ca8a-4171-81f5-f7c375717458 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:24.368614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd12fb00-ca8a-4171-81f5-f7c375717458 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:24.369058 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd12fb00-ca8a-4171-81f5-f7c375717458 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:24.371981 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd12fb00-ca8a-4171-81f5-f7c375717458 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:24.371981 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fd12fb00-ca8a-4171-81f5-f7c375717458 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:24.514530 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fd12fb00-ca8a-4171-81f5-f7c375717458 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:24.522722 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fd12fb00-ca8a-4171-81f5-f7c375717458 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:24.525254 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fd12fb00-ca8a-4171-81f5-f7c375717458 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:24.525442 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fd12fb00-ca8a-4171-81f5-f7c375717458 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.167842 May 17 22:16:24.525971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 548/1072] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:24 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:16:24.701627 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-47a35ba7-cce4-46dd-bcd6-fbaaa9256482 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:24.702218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-47a35ba7-cce4-46dd-bcd6-fbaaa9256482 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:24.708928 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-47a35ba7-cce4-46dd-bcd6-fbaaa9256482 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:24.709373 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-47a35ba7-cce4-46dd-bcd6-fbaaa9256482 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:24.710135 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-47a35ba7-cce4-46dd-bcd6-fbaaa9256482 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:24.710565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-47a35ba7-cce4-46dd-bcd6-fbaaa9256482 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:24.735193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-47a35ba7-cce4-46dd-bcd6-fbaaa9256482 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:16:25.180918 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-47a35ba7-cce4-46dd-bcd6-fbaaa9256482 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 204 len: 0 microversion: 2.1 time: 0.483064 May 17 22:16:25.181491 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 525/1073] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:16:24 2022] DELETE /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:16:25.189992 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ccea644a-0074-4100-9a5d-94c7109b31cb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:25.195157 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ccea644a-0074-4100-9a5d-94c7109b31cb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:25.197065 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ccea644a-0074-4100-9a5d-94c7109b31cb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:25.197516 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ccea644a-0074-4100-9a5d-94c7109b31cb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:25.198281 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ccea644a-0074-4100-9a5d-94c7109b31cb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:25.198712 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ccea644a-0074-4100-9a5d-94c7109b31cb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:25.544559 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7c249d1c-cba5-43db-b0af-52b186a82552 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:25.545368 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7c249d1c-cba5-43db-b0af-52b186a82552 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:25.552366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c249d1c-cba5-43db-b0af-52b186a82552 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:25.552801 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c249d1c-cba5-43db-b0af-52b186a82552 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:25.553783 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c249d1c-cba5-43db-b0af-52b186a82552 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:25.554017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7c249d1c-cba5-43db-b0af-52b186a82552 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:25.614170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ccea644a-0074-4100-9a5d-94c7109b31cb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:25.621606 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ccea644a-0074-4100-9a5d-94c7109b31cb tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1681 microversion: 2.1 time: 0.435757 May 17 22:16:25.622169 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 549/1074] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:16:25 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1681 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:16:25.696183 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7c249d1c-cba5-43db-b0af-52b186a82552 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:25.703782 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7c249d1c-cba5-43db-b0af-52b186a82552 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:25.705263 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7c249d1c-cba5-43db-b0af-52b186a82552 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:25.707323 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7c249d1c-cba5-43db-b0af-52b186a82552 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.166360 May 17 22:16:25.707940 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 526/1075] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:25 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:16:25.866253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fabbc2e9-9b05-4be5-938c-f4b597fc769e tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] Calling method '.version_select at 0x7f09f21450d0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:25.912357 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fabbc2e9-9b05-4be5-938c-f4b597fc769e tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/fa83c7b3-59e3-4ade-8d22-2622eb6fa04f" status: 200 len: 351 microversion: 2.1 time: 0.050227 May 17 22:16:25.912943 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 550/1076] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:16:25 2022] GET /compute/v2.1/os-volumes/fa83c7b3-59e3-4ade-8d22-2622eb6fa04f => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:26.639296 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-10b97207-d6fa-4769-8f11-f03ed0cbfb55 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:26.639920 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-10b97207-d6fa-4769-8f11-f03ed0cbfb55 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:26.651332 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10b97207-d6fa-4769-8f11-f03ed0cbfb55 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:26.651332 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10b97207-d6fa-4769-8f11-f03ed0cbfb55 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:26.651332 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10b97207-d6fa-4769-8f11-f03ed0cbfb55 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:26.651332 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-10b97207-d6fa-4769-8f11-f03ed0cbfb55 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:26.727233 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-47c7590e-ea43-41ad-846e-6482bfdcd3be tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:26.728843 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-47c7590e-ea43-41ad-846e-6482bfdcd3be tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:26.741634 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47c7590e-ea43-41ad-846e-6482bfdcd3be tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:26.742537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47c7590e-ea43-41ad-846e-6482bfdcd3be tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:26.743581 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47c7590e-ea43-41ad-846e-6482bfdcd3be tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:26.745997 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47c7590e-ea43-41ad-846e-6482bfdcd3be tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:26.831472 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-10b97207-d6fa-4769-8f11-f03ed0cbfb55 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:26.839266 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-10b97207-d6fa-4769-8f11-f03ed0cbfb55 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1681 microversion: 2.1 time: 0.203665 May 17 22:16:26.839822 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 527/1077] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:16:26 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:16:26.912618 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-47c7590e-ea43-41ad-846e-6482bfdcd3be tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:26.920912 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-47c7590e-ea43-41ad-846e-6482bfdcd3be tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:26.922460 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-47c7590e-ea43-41ad-846e-6482bfdcd3be tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:26.924156 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-47c7590e-ea43-41ad-846e-6482bfdcd3be tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.202486 May 17 22:16:26.936991 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 551/1078] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:26 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:16:27.701510 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-2bedfe10-8b63-4409-9a09-b05a8992a516 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] Calling method '.version_select at 0x7f09f21a0310>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:27.762447 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-2bedfe10-8b63-4409-9a09-b05a8992a516 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/27ecac38-d72e-4da5-a798-b0242dd6acb1" status: 200 len: 350 microversion: 2.1 time: 0.063871 May 17 22:16:27.762447 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 528/1079] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:16:27 2022] GET /compute/v2.1/os-volumes/27ecac38-d72e-4da5-a798-b0242dd6acb1 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:27.857334 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5cb749de-3bec-4f23-8b8b-90d8c3d93423 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:27.858373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-5cb749de-3bec-4f23-8b8b-90d8c3d93423 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:27.864922 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5cb749de-3bec-4f23-8b8b-90d8c3d93423 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:27.865378 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5cb749de-3bec-4f23-8b8b-90d8c3d93423 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:27.866185 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5cb749de-3bec-4f23-8b8b-90d8c3d93423 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:27.866802 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-5cb749de-3bec-4f23-8b8b-90d8c3d93423 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:27.942358 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e7daca84-882b-4601-a7a2-09e8dfcaf553 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:27.943005 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-e7daca84-882b-4601-a7a2-09e8dfcaf553 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:27.949720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7daca84-882b-4601-a7a2-09e8dfcaf553 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:27.950169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7daca84-882b-4601-a7a2-09e8dfcaf553 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:27.950941 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7daca84-882b-4601-a7a2-09e8dfcaf553 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:27.951395 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-e7daca84-882b-4601-a7a2-09e8dfcaf553 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:28.079410 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-5cb749de-3bec-4f23-8b8b-90d8c3d93423 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:28.087824 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5cb749de-3bec-4f23-8b8b-90d8c3d93423 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1614 microversion: 2.1 time: 0.234185 May 17 22:16:28.088752 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 552/1080] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:16:27 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1614 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:16:28.217281 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e7daca84-882b-4601-a7a2-09e8dfcaf553 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:28.225693 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e7daca84-882b-4601-a7a2-09e8dfcaf553 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:28.227369 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-e7daca84-882b-4601-a7a2-09e8dfcaf553 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:28.228761 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e7daca84-882b-4601-a7a2-09e8dfcaf553 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1726 microversion: 2.20 time: 0.290603 May 17 22:16:28.229502 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 529/1081] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:27 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1726 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 22:16:28.328639 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-43405d2a-fffd-4022-8a28-40cdd8171e9d req-77d559ed-3e6e-4900-92c2-34d466da9243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3fa9042-8c2f-46bd-8570-97f8e8585216", "name": "network-vif-deleted", "tag": "d95aec15-6d35-4b78-ab7f-a8a90baf08e7"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:16:28.340609 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-43405d2a-fffd-4022-8a28-40cdd8171e9d req-77d559ed-3e6e-4900-92c2-34d466da9243 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:28.341382 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-43405d2a-fffd-4022-8a28-40cdd8171e9d req-77d559ed-3e6e-4900-92c2-34d466da9243 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:28.354836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-43405d2a-fffd-4022-8a28-40cdd8171e9d req-77d559ed-3e6e-4900-92c2-34d466da9243 service nova] Creating event network-vif-deleted:d95aec15-6d35-4b78-ab7f-a8a90baf08e7 for instance f3fa9042-8c2f-46bd-8570-97f8e8585216 on hv-cinder-83998 May 17 22:16:28.361169 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-43405d2a-fffd-4022-8a28-40cdd8171e9d req-77d559ed-3e6e-4900-92c2-34d466da9243 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036111 May 17 22:16:28.361641 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 553/1082] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:29.105841 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-640c00d1-a787-40fc-86c9-3046726b57f0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:29.106658 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-640c00d1-a787-40fc-86c9-3046726b57f0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:29.113812 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-640c00d1-a787-40fc-86c9-3046726b57f0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:29.114260 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-640c00d1-a787-40fc-86c9-3046726b57f0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:29.115035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-640c00d1-a787-40fc-86c9-3046726b57f0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:29.115487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-640c00d1-a787-40fc-86c9-3046726b57f0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:29.161136 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-640c00d1-a787-40fc-86c9-3046726b57f0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:29.161585 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-640c00d1-a787-40fc-86c9-3046726b57f0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:29.162042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-640c00d1-a787-40fc-86c9-3046726b57f0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lazy-loading 'fault' on Instance uuid f3fa9042-8c2f-46bd-8570-97f8e8585216 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:16:29.206186 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-640c00d1-a787-40fc-86c9-3046726b57f0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bbb6a0a08464e738ef0d062dfe87182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0809b61be446a69359b69b50b61710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:29.214812 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-640c00d1-a787-40fc-86c9-3046726b57f0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 200 len: 1331 microversion: 2.1 time: 0.113019 May 17 22:16:29.215729 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 530/1083] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:16:29 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:16:29.248863 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4d732230-6e27-40d6-b5ea-d388c7461e24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:29.249617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4d732230-6e27-40d6-b5ea-d388c7461e24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:29.256663 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4d732230-6e27-40d6-b5ea-d388c7461e24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:29.257245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4d732230-6e27-40d6-b5ea-d388c7461e24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:29.258055 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4d732230-6e27-40d6-b5ea-d388c7461e24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:29.258563 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4d732230-6e27-40d6-b5ea-d388c7461e24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:29.403506 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4d732230-6e27-40d6-b5ea-d388c7461e24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:29.412788 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4d732230-6e27-40d6-b5ea-d388c7461e24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:29.414449 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4d732230-6e27-40d6-b5ea-d388c7461e24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:16:29.415649 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4d732230-6e27-40d6-b5ea-d388c7461e24 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1713 microversion: 2.20 time: 0.171644 May 17 22:16:29.416203 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 554/1084] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:16:29 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1713 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:16:29.553650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-500c0237-a759-4ee6-b66d-beeaa0561ffc tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] Calling method '.version_select at 0x7f09f1fa8310>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:29.601750 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-500c0237-a759-4ee6-b66d-beeaa0561ffc tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/431d6cea-b549-4337-85c5-45c0661be578" status: 200 len: 351 microversion: 2.1 time: 0.052075 May 17 22:16:29.602316 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 531/1085] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:16:29 2022] GET /compute/v2.1/os-volumes/431d6cea-b549-4337-85c5-45c0661be578 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:29.614396 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-11c67cf3-ac24-48e9-a2b9-4604db8f2cc7 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] Calling method '.version_select at 0x7f09f21564c0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:29.694190 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-11c67cf3-ac24-48e9-a2b9-4604db8f2cc7 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084327 May 17 22:16:29.694764 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 555/1086] 10.222.0.24 () {58 vars in 1133 bytes} [Tue May 17 22:16:29 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:16:29.707849 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-21163e91-2346-490c-b216-61599b7edfe7 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] Calling method '.version_select at 0x7f09f204e4c0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:29.787068 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-21163e91-2346-490c-b216-61599b7edfe7 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083574 May 17 22:16:29.787666 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 532/1087] 10.222.0.24 () {58 vars in 1148 bytes} [Tue May 17 22:16:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:29.799249 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-5689411b-5512-4512-a606-246d2ff24d71 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] Calling method '.version_select at 0x7f09f221f820>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:29.880882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-5689411b-5512-4512-a606-246d2ff24d71 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085325 May 17 22:16:29.881624 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 556/1088] 10.222.0.24 () {58 vars in 1133 bytes} [Tue May 17 22:16:29 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:16:29.892738 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d5dcbf83-39ae-4a91-aeb5-313ddbe390be tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] Calling method '.version_select at 0x7f09f21533a0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:29.973039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d5dcbf83-39ae-4a91-aeb5-313ddbe390be tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084054 May 17 22:16:29.973615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 533/1089] 10.222.0.24 () {58 vars in 1166 bytes} [Tue May 17 22:16:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:29.985214 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-bf37be01-0fb3-4e59-9d05-111f5065d598 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] Calling method '.version_select at 0x7f09f218b310>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:30.065281 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-bf37be01-0fb3-4e59-9d05-111f5065d598 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083787 May 17 22:16:30.069555 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 557/1090] 10.222.0.24 () {58 vars in 1169 bytes} [Tue May 17 22:16:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:30.081951 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a184b1a6-08dd-4d1b-806f-52389c12e4c6 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] Calling method '.version_select at 0x7f09f21535e0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:30.162065 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a184b1a6-08dd-4d1b-806f-52389c12e4c6 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084378 May 17 22:16:30.162809 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 534/1091] 10.222.0.24 () {58 vars in 1154 bytes} [Tue May 17 22:16:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:16:30.173895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8dc69533-8a75-4251-9757-01a349ce4f86 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] Calling method '.version_select at 0x7f09f218b9d0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:30.233187 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ddb599d6-7d67-43b4-b246-4f38646b8a97 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:30.233797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ddb599d6-7d67-43b4-b246-4f38646b8a97 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:30.240220 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ddb599d6-7d67-43b4-b246-4f38646b8a97 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:30.240682 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ddb599d6-7d67-43b4-b246-4f38646b8a97 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:30.241519 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ddb599d6-7d67-43b4-b246-4f38646b8a97 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:30.241960 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ddb599d6-7d67-43b4-b246-4f38646b8a97 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:30.256034 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8dc69533-8a75-4251-9757-01a349ce4f86 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083555 May 17 22:16:30.256034 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 558/1092] 10.222.0.24 () {58 vars in 1187 bytes} [Tue May 17 22:16:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:16:30.256574 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-ddb599d6-7d67-43b4-b246-4f38646b8a97 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ddb599d6-7d67-43b4-b246-4f38646b8a97 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 HTTP/1.1 May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:16:30.257264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:16:30.258910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:30.258910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:30.258910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:30.258910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:30.258910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:30.258910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:16:30.258910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:16:30.258910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:16:30.258910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:30.258910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:16:30.258910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:30.258910 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': 'f3fa9042-8c2f-46bd-8570-97f8e8585216'} May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:30.260028 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:30.261879 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:30.263395 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ddb599d6-7d67-43b4-b246-4f38646b8a97 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 404 to user: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:30.263395 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ddb599d6-7d67-43b4-b246-4f38646b8a97 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 404 len: 111 microversion: 2.1 time: 0.029495 May 17 22:16:30.263395 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 535/1093] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:16:30 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 22:16:30.266307 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-edb2c0ea-1fd4-4407-9246-ba803ac2a1a4 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] Calling method '.version_select at 0x7f09f21564c0>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:30.273838 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-38b19a3a-9ee6-46b8-b330-4b09bee18fb5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '.version_select at 0x7f09f2145280>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:30.350196 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-edb2c0ea-1fd4-4407-9246-ba803ac2a1a4 tempest-VolumesTestJSON-1319609554 tempest-VolumesTestJSON-1319609554-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087604 May 17 22:16:30.350773 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 559/1094] 10.222.0.24 () {58 vars in 1154 bytes} [Tue May 17 22:16:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:16:30.366960 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-38b19a3a-9ee6-46b8-b330-4b09bee18fb5 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538369640" status: 202 len: 0 microversion: 2.1 time: 0.096766 May 17 22:16:30.367643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 536/1095] 10.222.0.24 () {58 vars in 1220 bytes} [Tue May 17 22:16:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538369640 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:16:32.692031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3bd2ea73-e6cf-475f-8dbf-c836896a7206 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:32.693035 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3bd2ea73-e6cf-475f-8dbf-c836896a7206 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:32.698858 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bd2ea73-e6cf-475f-8dbf-c836896a7206 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:32.699344 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bd2ea73-e6cf-475f-8dbf-c836896a7206 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:32.700116 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bd2ea73-e6cf-475f-8dbf-c836896a7206 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:32.700553 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3bd2ea73-e6cf-475f-8dbf-c836896a7206 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:32.714559 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-3bd2ea73-e6cf-475f-8dbf-c836896a7206 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3bd2ea73-e6cf-475f-8dbf-c836896a7206 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: DELETE /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 HTTP/1.1 May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:16:32.716229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:16:32.718695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:32.718695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:32.718695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:32.718695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:32.718695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:32.718695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:16:32.718695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:16:32.718695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:16:32.718695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:32.718695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:16:32.718695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:32.718695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': 'f3fa9042-8c2f-46bd-8570-97f8e8585216'} May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:32.719707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:32.721477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:32.723522 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3bd2ea73-e6cf-475f-8dbf-c836896a7206 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 404 to user: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:32.723522 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3bd2ea73-e6cf-475f-8dbf-c836896a7206 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 404 len: 111 microversion: 2.1 time: 0.030288 May 17 22:16:32.723522 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 560/1096] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:16:32 2022] DELETE /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:32.727389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f88785b9-6c25-4a54-a858-9ada84349bd0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:32.727998 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f88785b9-6c25-4a54-a858-9ada84349bd0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: f3fa9042-8c2f-46bd-8570-97f8e8585216] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:32.734444 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f88785b9-6c25-4a54-a858-9ada84349bd0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:32.734887 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f88785b9-6c25-4a54-a858-9ada84349bd0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:32.735674 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f88785b9-6c25-4a54-a858-9ada84349bd0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:32.736104 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f88785b9-6c25-4a54-a858-9ada84349bd0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:32.749679 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-f88785b9-6c25-4a54-a858-9ada84349bd0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f88785b9-6c25-4a54-a858-9ada84349bd0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 HTTP/1.1 May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:16:32.751230 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:16:32.753039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:32.753039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:32.753039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:32.753039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:32.753039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:32.753039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:16:32.753039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:16:32.753039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:16:32.753039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:32.753039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:16:32.753039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:32.753039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': 'f3fa9042-8c2f-46bd-8570-97f8e8585216'} May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:32.754053 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. May 17 22:16:32.755616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:32.757170 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f88785b9-6c25-4a54-a858-9ada84349bd0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 404 to user: Instance f3fa9042-8c2f-46bd-8570-97f8e8585216 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:32.757170 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f88785b9-6c25-4a54-a858-9ada84349bd0 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216" status: 404 len: 111 microversion: 2.1 time: 0.029595 May 17 22:16:32.757170 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 537/1097] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:16:32 2022] GET /compute/v2.1/servers/f3fa9042-8c2f-46bd-8570-97f8e8585216 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 22:16:34.043989 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-21220e48-7f56-4d55-9a26-4f733b135672 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:34.044422 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-21220e48-7f56-4d55-9a26-4f733b135672 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:34.051295 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-21220e48-7f56-4d55-9a26-4f733b135672 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:34.051741 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-21220e48-7f56-4d55-9a26-4f733b135672 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:34.052500 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-21220e48-7f56-4d55-9a26-4f733b135672 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:34.052927 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-21220e48-7f56-4d55-9a26-4f733b135672 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:34.067033 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-21220e48-7f56-4d55-9a26-4f733b135672 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-21220e48-7f56-4d55-9a26-4f733b135672 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: DELETE /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 HTTP/1.1 May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:16:34.068611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:16:34.073121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:34.073121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:34.073121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:34.073121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:34.073121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:34.073121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:16:34.073121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:16:34.073121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:16:34.073121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:34.073121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:16:34.073121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:16:34.073121 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': 'af3dd261-a8e5-4aa9-a950-77e2ce94cc45'} May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:34.074115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:16:34.075691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:34.077239 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-21220e48-7f56-4d55-9a26-4f733b135672 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 404 to user: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:34.077239 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-21220e48-7f56-4d55-9a26-4f733b135672 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 404 len: 111 microversion: 2.1 time: 0.031167 May 17 22:16:34.077239 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 561/1098] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:16:34 2022] DELETE /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:34.078663 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d543a9f7-045c-4ea5-9751-dfe29908b089 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:34.079312 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d543a9f7-045c-4ea5-9751-dfe29908b089 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: af3dd261-a8e5-4aa9-a950-77e2ce94cc45] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:34.085469 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d543a9f7-045c-4ea5-9751-dfe29908b089 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:34.085920 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d543a9f7-045c-4ea5-9751-dfe29908b089 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:34.086691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d543a9f7-045c-4ea5-9751-dfe29908b089 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:34.087156 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d543a9f7-045c-4ea5-9751-dfe29908b089 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:34.101195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-d543a9f7-045c-4ea5-9751-dfe29908b089 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d543a9f7-045c-4ea5-9751-dfe29908b089 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 HTTP/1.1 May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:16:34.102720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:16:34.104539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:34.104539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:34.104539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:34.104539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:34.104539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:34.104539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:16:34.104539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:16:34.104539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:16:34.104539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:34.104539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:16:34.104539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:16:34.104539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': 'af3dd261-a8e5-4aa9-a950-77e2ce94cc45'} May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:34.105588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. May 17 22:16:34.107146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:34.108826 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d543a9f7-045c-4ea5-9751-dfe29908b089 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 404 to user: Instance af3dd261-a8e5-4aa9-a950-77e2ce94cc45 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:34.108826 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d543a9f7-045c-4ea5-9751-dfe29908b089 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45" status: 404 len: 111 microversion: 2.1 time: 0.029400 May 17 22:16:34.108826 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 538/1099] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:16:34 2022] GET /compute/v2.1/servers/af3dd261-a8e5-4aa9-a950-77e2ce94cc45 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:34.113406 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-68c8db99-3355-488b-ae41-a74a95d06cea tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:34.113894 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-68c8db99-3355-488b-ae41-a74a95d06cea tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:34.119797 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68c8db99-3355-488b-ae41-a74a95d06cea tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:34.123680 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68c8db99-3355-488b-ae41-a74a95d06cea tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:34.123680 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68c8db99-3355-488b-ae41-a74a95d06cea tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:34.123680 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-68c8db99-3355-488b-ae41-a74a95d06cea tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:34.134685 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-68c8db99-3355-488b-ae41-a74a95d06cea tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-68c8db99-3355-488b-ae41-a74a95d06cea tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: DELETE /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca HTTP/1.1 May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:16:34.136269 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:16:34.137883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:34.137883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:34.137883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:34.137883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:34.137883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:34.137883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:16:34.137883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:16:34.137883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:16:34.137883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:34.137883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:16:34.137883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:16:34.137883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '429a5e1d-02ff-43b5-a293-584d721f62ca'} May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:34.139900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:16:34.141636 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:34.143170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-68c8db99-3355-488b-ae41-a74a95d06cea tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 404 to user: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:34.143170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-68c8db99-3355-488b-ae41-a74a95d06cea tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 404 len: 111 microversion: 2.1 time: 0.028929 May 17 22:16:34.143170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 562/1100] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:16:34 2022] DELETE /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:34.145993 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d1ac13a5-b8bc-4e10-8ed6-f7e04f7ed2fd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:34.146604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d1ac13a5-b8bc-4e10-8ed6-f7e04f7ed2fd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 429a5e1d-02ff-43b5-a293-584d721f62ca] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:34.152480 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1ac13a5-b8bc-4e10-8ed6-f7e04f7ed2fd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:34.152924 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1ac13a5-b8bc-4e10-8ed6-f7e04f7ed2fd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:34.153683 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1ac13a5-b8bc-4e10-8ed6-f7e04f7ed2fd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:34.154124 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d1ac13a5-b8bc-4e10-8ed6-f7e04f7ed2fd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:34.167929 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-d1ac13a5-b8bc-4e10-8ed6-f7e04f7ed2fd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d1ac13a5-b8bc-4e10-8ed6-f7e04f7ed2fd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca HTTP/1.1 May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:16:34.169429 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:16:34.171042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:34.171042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:34.171042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:34.171042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:34.171042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:34.171042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:16:34.171042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:16:34.171042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:16:34.171042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:34.171042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:16:34.171042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:16:34.171042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '429a5e1d-02ff-43b5-a293-584d721f62ca'} May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:34.172121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. May 17 22:16:34.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:34.176399 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d1ac13a5-b8bc-4e10-8ed6-f7e04f7ed2fd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 404 to user: Instance 429a5e1d-02ff-43b5-a293-584d721f62ca could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:34.176399 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d1ac13a5-b8bc-4e10-8ed6-f7e04f7ed2fd tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca" status: 404 len: 111 microversion: 2.1 time: 0.028716 May 17 22:16:34.176399 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 539/1101] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:16:34 2022] GET /compute/v2.1/servers/429a5e1d-02ff-43b5-a293-584d721f62ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:36.463281 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fccbf190-4e24-4d02-8191-770d93cc249e tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Action: 'create', calling method: .version_select at 0x7f09f21a4ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1548443297", "metadata": {"Type": "work"}}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fccbf190-4e24-4d02-8191-770d93cc249e tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Request method failure captured: May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 122 May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB7E5LaFiRjkGGsexkWp2V7FGSjAEw4A8ucAX1of-kxcybfi8D6bIQxCeuP7-jKRdVwKpm8XZPiwK5WJnf8JjAcgSxOHjOmKiJIi1RW7sxjVhn9D4PaAwKpUeRNn-bBifDY2SKm_jFh7I4Z3XwTZC9yp83D3jrhAa0hLdBk7yfslCfg May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 35930c06615847488b788ba3c75ff80f May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:16:36.475414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/35930c06615847488b788ba3c75ff80f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_35930c06615847488b788ba3c75ff80f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/35930c06615847488b788ba3c75ff80f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/35930c06615847488b788ba3c75ff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 35930c06615847488b788ba3c75ff80f May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-VolumesNegativeTest-894931381-project May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 6099c17550a74c9d8883af8a75d6767b May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-VolumesNegativeTest-894931381-project May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1548443297", "metadata": {"Type": "work"}}} May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: May 17 22:16:36.481314 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1548443297', 'metadata': {'Type': 'work'}}}} May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise error May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi '#$%' May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:36.482170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 22:16:36.483603 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 22:16:36.484812 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 22:16:36.484812 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.484812 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fccbf190-4e24-4d02-8191-770d93cc249e tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:36.484812 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fccbf190-4e24-4d02-8191-770d93cc249e tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.125662 May 17 22:16:36.484812 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 563/1102] 10.222.0.24 () {60 vars in 1155 bytes} [Tue May 17 22:16:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 22:16:36.487243 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e6176c8f-6970-4d9f-a1dc-3838a472b104 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Action: 'create', calling method: .version_select at 0x7f09f21b5310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-735266886", "metadata": {"Type": "work"}}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e6176c8f-6970-4d9f-a1dc-3838a472b104 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Request method failure captured: May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 119 May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB7E5LaFiRjkGGsexkWp2V7FGSjAEw4A8ucAX1of-kxcybfi8D6bIQxCeuP7-jKRdVwKpm8XZPiwK5WJnf8JjAcgSxOHjOmKiJIi1RW7sxjVhn9D4PaAwKpUeRNn-bBifDY2SKm_jFh7I4Z3XwTZC9yp83D3jrhAa0hLdBk7yfslCfg May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 35930c06615847488b788ba3c75ff80f May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:16:36.490495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/35930c06615847488b788ba3c75ff80f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_35930c06615847488b788ba3c75ff80f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/35930c06615847488b788ba3c75ff80f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/35930c06615847488b788ba3c75ff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 35930c06615847488b788ba3c75ff80f May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-VolumesNegativeTest-894931381-project May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 6099c17550a74c9d8883af8a75d6767b May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-VolumesNegativeTest-894931381-project May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-735266886", "metadata": {"Type": "work"}}} May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: May 17 22:16:36.492178 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-735266886', 'metadata': {'Type': 'work'}}}} May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise error May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi '0' May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:36.494142 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 22:16:36.496328 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 22:16:36.497797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 22:16:36.497797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.497797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-e6176c8f-6970-4d9f-a1dc-3838a472b104 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:36.497797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-e6176c8f-6970-4d9f-a1dc-3838a472b104 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008536 May 17 22:16:36.497797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 540/1103] 10.222.0.24 () {60 vars in 1155 bytes} [Tue May 17 22:16:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 22:16:36.502524 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-75f7bdb9-1800-40ef-a9a3-fd93f395c037 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Action: 'create', calling method: .version_select at 0x7f09f21453a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1723873836", "metadata": {"Type": "work"}}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-75f7bdb9-1800-40ef-a9a3-fd93f395c037 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Request method failure captured: May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 119 May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB7E5LaFiRjkGGsexkWp2V7FGSjAEw4A8ucAX1of-kxcybfi8D6bIQxCeuP7-jKRdVwKpm8XZPiwK5WJnf8JjAcgSxOHjOmKiJIi1RW7sxjVhn9D4PaAwKpUeRNn-bBifDY2SKm_jFh7I4Z3XwTZC9yp83D3jrhAa0hLdBk7yfslCfg May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 35930c06615847488b788ba3c75ff80f May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:16:36.505866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/35930c06615847488b788ba3c75ff80f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_35930c06615847488b788ba3c75ff80f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/35930c06615847488b788ba3c75ff80f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/35930c06615847488b788ba3c75ff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 35930c06615847488b788ba3c75ff80f May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-VolumesNegativeTest-894931381-project May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 6099c17550a74c9d8883af8a75d6767b May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-VolumesNegativeTest-894931381-project May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1723873836", "metadata": {"Type": "work"}}} May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: May 17 22:16:36.507520 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1723873836', 'metadata': {'Type': 'work'}}}} May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise error May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi '' May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:36.508537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 22:16:36.509882 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 22:16:36.511066 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 22:16:36.511066 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.511066 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-75f7bdb9-1800-40ef-a9a3-fd93f395c037 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:36.511066 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-75f7bdb9-1800-40ef-a9a3-fd93f395c037 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009803 May 17 22:16:36.511066 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 564/1104] 10.222.0.24 () {60 vars in 1155 bytes} [Tue May 17 22:16:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 22:16:36.518854 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-63186c1f-065c-4f99-897f-2ce277d69219 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Calling method '.version_select at 0x7f09f22e25e0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:36.547197 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-63186c1f-065c-4f99-897f-2ce277d69219 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] HTTP exception thrown: Volume tempest-invalid-753728830 could not be found. May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-63186c1f-065c-4f99-897f-2ce277d69219 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Request method failure captured: May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-753728830 HTTP/1.1 May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB7E5LaFiRjkGGsexkWp2V7FGSjAEw4A8ucAX1of-kxcybfi8D6bIQxCeuP7-jKRdVwKpm8XZPiwK5WJnf8JjAcgSxOHjOmKiJIi1RW7sxjVhn9D4PaAwKpUeRNn-bBifDY2SKm_jFh7I4Z3XwTZC9yp83D3jrhAa0hLdBk7yfslCfg May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 35930c06615847488b788ba3c75ff80f May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:16:36.549169 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/35930c06615847488b788ba3c75ff80f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_35930c06615847488b788ba3c75ff80f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/35930c06615847488b788ba3c75ff80f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/35930c06615847488b788ba3c75ff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 35930c06615847488b788ba3c75ff80f May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-VolumesNegativeTest-894931381-project May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 6099c17550a74c9d8883af8a75d6767b May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-VolumesNegativeTest-894931381-project May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Volume tempest-invalid-753728830 could not be found. May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': 'tempest-invalid-753728830'} May 17 22:16:36.550747 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-753728830 could not be found. (HTTP 404) (Request-ID: req-c7f62e92-7acc-495c-88ea-52f8b5bb6111) May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.551851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 22:16:36.553259 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-753728830 could not be found. May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:36.554635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-753728830 could not be found. May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-753728830 could not be found. May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-63186c1f-065c-4f99-897f-2ce277d69219 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Returning 404 to user: Volume tempest-invalid-753728830 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-63186c1f-065c-4f99-897f-2ce277d69219 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-753728830" status: 404 len: 98 microversion: 2.1 time: 0.036110 May 17 22:16:36.558366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 541/1105] 10.222.0.24 () {58 vars in 1214 bytes} [Tue May 17 22:16:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-753728830 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 17 22:16:36.565892 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-be6d469b-75e6-4baa-a2ce-278468277879 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004126 May 17 22:16:36.566484 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 565/1106] 10.222.0.24 () {58 vars in 1139 bytes} [Tue May 17 22:16:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 17 22:16:36.574798 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f6b85d96-7f97-4b8b-961b-91791d36b392 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003762 May 17 22:16:36.575389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 542/1107] 10.222.0.24 () {58 vars in 1136 bytes} [Tue May 17 22:16:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 17 22:16:36.583432 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7fc5072c-9834-4015-a902-b9dc818e9a09 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Calling method '.version_select at 0x7f09f2133a60>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:36.611013 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-7fc5072c-9834-4015-a902-b9dc818e9a09 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] HTTP exception thrown: Volume 9c5ccac0-9fe8-4ca3-8e61-1f30943dfa92 could not be found. May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7fc5072c-9834-4015-a902-b9dc818e9a09 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Request method failure captured: May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: DELETE /compute/v2.1/os-volumes/9c5ccac0-9fe8-4ca3-8e61-1f30943dfa92 HTTP/1.1 May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB7E5LaFiRjkGGsexkWp2V7FGSjAEw4A8ucAX1of-kxcybfi8D6bIQxCeuP7-jKRdVwKpm8XZPiwK5WJnf8JjAcgSxOHjOmKiJIi1RW7sxjVhn9D4PaAwKpUeRNn-bBifDY2SKm_jFh7I4Z3XwTZC9yp83D3jrhAa0hLdBk7yfslCfg May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 35930c06615847488b788ba3c75ff80f May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:16:36.613019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/35930c06615847488b788ba3c75ff80f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_35930c06615847488b788ba3c75ff80f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/35930c06615847488b788ba3c75ff80f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/35930c06615847488b788ba3c75ff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 35930c06615847488b788ba3c75ff80f May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-VolumesNegativeTest-894931381-project May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 6099c17550a74c9d8883af8a75d6767b May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-VolumesNegativeTest-894931381-project May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Volume 9c5ccac0-9fe8-4ca3-8e61-1f30943dfa92 could not be found. May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '9c5ccac0-9fe8-4ca3-8e61-1f30943dfa92'} May 17 22:16:36.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9c5ccac0-9fe8-4ca3-8e61-1f30943dfa92 could not be found. (HTTP 404) (Request-ID: req-62ec8d74-3a02-49da-a282-27603ca42581) May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.620317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 22:16:36.621850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9c5ccac0-9fe8-4ca3-8e61-1f30943dfa92 could not be found. May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 22:16:36.623319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9c5ccac0-9fe8-4ca3-8e61-1f30943dfa92 could not be found. May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9c5ccac0-9fe8-4ca3-8e61-1f30943dfa92 could not be found. May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7fc5072c-9834-4015-a902-b9dc818e9a09 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Returning 404 to user: Volume 9c5ccac0-9fe8-4ca3-8e61-1f30943dfa92 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7fc5072c-9834-4015-a902-b9dc818e9a09 tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/9c5ccac0-9fe8-4ca3-8e61-1f30943dfa92" status: 404 len: 109 microversion: 2.1 time: 0.034598 May 17 22:16:36.624737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 566/1108] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 17 22:16:36 2022] DELETE /compute/v2.1/os-volumes/9c5ccac0-9fe8-4ca3-8e61-1f30943dfa92 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:36.625791 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-93645107-a72b-475f-95e4-37d58e7ce9ed tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Calling method '.version_select at 0x7f09f25cb700>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:36.651189 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-93645107-a72b-475f-95e4-37d58e7ce9ed tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] HTTP exception thrown: Volume ae8a07b7-a759-4324-9acb-d11619ee825c could not be found. May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-93645107-a72b-475f-95e4-37d58e7ce9ed tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Request method failure captured: May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/os-volumes/ae8a07b7-a759-4324-9acb-d11619ee825c HTTP/1.1 May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB7E5LaFiRjkGGsexkWp2V7FGSjAEw4A8ucAX1of-kxcybfi8D6bIQxCeuP7-jKRdVwKpm8XZPiwK5WJnf8JjAcgSxOHjOmKiJIi1RW7sxjVhn9D4PaAwKpUeRNn-bBifDY2SKm_jFh7I4Z3XwTZC9yp83D3jrhAa0hLdBk7yfslCfg May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 35930c06615847488b788ba3c75ff80f May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:16:36.653108 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/35930c06615847488b788ba3c75ff80f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_35930c06615847488b788ba3c75ff80f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/35930c06615847488b788ba3c75ff80f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/35930c06615847488b788ba3c75ff80f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 35930c06615847488b788ba3c75ff80f May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-VolumesNegativeTest-894931381 May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-VolumesNegativeTest-894931381-project May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 6099c17550a74c9d8883af8a75d6767b May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-VolumesNegativeTest-894931381-project May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Volume ae8a07b7-a759-4324-9acb-d11619ee825c could not be found. May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': 'ae8a07b7-a759-4324-9acb-d11619ee825c'} May 17 22:16:36.654788 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae8a07b7-a759-4324-9acb-d11619ee825c could not be found. (HTTP 404) (Request-ID: req-f886e926-074f-4d48-b880-1595e4c6034e) May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.655956 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 22:16:36.657193 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae8a07b7-a759-4324-9acb-d11619ee825c could not be found. May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 22:16:36.658350 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae8a07b7-a759-4324-9acb-d11619ee825c could not be found. May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae8a07b7-a759-4324-9acb-d11619ee825c could not be found. May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-93645107-a72b-475f-95e4-37d58e7ce9ed tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] Returning 404 to user: Volume ae8a07b7-a759-4324-9acb-d11619ee825c could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-93645107-a72b-475f-95e4-37d58e7ce9ed tempest-VolumesNegativeTest-894931381 tempest-VolumesNegativeTest-894931381-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/ae8a07b7-a759-4324-9acb-d11619ee825c" status: 404 len: 109 microversion: 2.1 time: 0.034051 May 17 22:16:36.659565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 543/1109] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:16:36 2022] GET /compute/v2.1/os-volumes/ae8a07b7-a759-4324-9acb-d11619ee825c => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:37.569383 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0714600a-6558-4a42-bebe-15a3556d8720 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:37.571883 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0714600a-6558-4a42-bebe-15a3556d8720 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:37.578629 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0714600a-6558-4a42-bebe-15a3556d8720 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:37.579083 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0714600a-6558-4a42-bebe-15a3556d8720 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:37.579916 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0714600a-6558-4a42-bebe-15a3556d8720 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:37.580686 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0714600a-6558-4a42-bebe-15a3556d8720 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:37.593601 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-0714600a-6558-4a42-bebe-15a3556d8720 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0714600a-6558-4a42-bebe-15a3556d8720 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: DELETE /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 HTTP/1.1 May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:16:37.595483 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:16:37.596855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:37.596855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:37.596855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:37.596855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:37.596855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:37.596855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:16:37.596855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:16:37.596855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:16:37.596855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:37.596855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:16:37.596855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:16:37.596855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '120f12ef-0f38-41f4-a47d-2fdb6ffe8831'} May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:37.601490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:16:37.603292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:16:37.604558 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0714600a-6558-4a42-bebe-15a3556d8720 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 404 to user: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:37.604558 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0714600a-6558-4a42-bebe-15a3556d8720 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "DELETE /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 404 len: 111 microversion: 2.1 time: 0.031552 May 17 22:16:37.604558 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 567/1110] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:16:37 2022] DELETE /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:16:37.611249 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4824634b-c1e1-40c5-8a77-cabaac880302 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:16:37.612388 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4824634b-c1e1-40c5-8a77-cabaac880302 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] [instance: 120f12ef-0f38-41f4-a47d-2fdb6ffe8831] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:16:37.619652 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4824634b-c1e1-40c5-8a77-cabaac880302 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:37.620098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4824634b-c1e1-40c5-8a77-cabaac880302 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:37.620874 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4824634b-c1e1-40c5-8a77-cabaac880302 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:16:37.621303 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4824634b-c1e1-40c5-8a77-cabaac880302 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:16:37.636950 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-4824634b-c1e1-40c5-8a77-cabaac880302 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] HTTP exception thrown: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4824634b-c1e1-40c5-8a77-cabaac880302 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Request method failure captured: May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 HTTP/1.1 May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0DYxzoRqykqnIiiW8xn7fj7S8CXuVXv9jk-APDw5DzoEkVRVkt8TAsYqB1pFFT5zYhie_AFcx8Ru8TqIMS4i8o9-j91M61upVgIbqe7gNj8CkduaMsAETSrQdikhRgTc_s6damM-oTeM7lzllyeChaDAdKZV9fAjP7iTIE30kRjhg May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:16:37.638522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:16:37.640121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ea0809b61be446a69359b69b50b61710", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ea0809b61be446a69359b69b50b61710"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ea0809b61be446a69359b69b50b61710"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:16:37.640121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:37.640121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: ea0809b61be446a69359b69b50b61710 May 17 22:16:37.640121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97352927 May 17 22:16:37.640121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:37.640121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:16:37.640121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:16:37.640121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 4bbb6a0a08464e738ef0d062dfe87182 May 17 22:16:37.640121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-AttachVolumeNegativeTest-97352927-project May 17 22:16:37.640121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:16:37.640121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:16:37.640121 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '120f12ef-0f38-41f4-a47d-2fdb6ffe8831'} May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:16:37.641034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. May 17 22:16:37.642346 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:16:37.643655 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4824634b-c1e1-40c5-8a77-cabaac880302 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] Returning 404 to user: Instance 120f12ef-0f38-41f4-a47d-2fdb6ffe8831 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:16:37.643655 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4824634b-c1e1-40c5-8a77-cabaac880302 tempest-AttachVolumeNegativeTest-97352927 tempest-AttachVolumeNegativeTest-97352927-project] 10.222.0.24 "GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831" status: 404 len: 111 microversion: 2.1 time: 0.033704 May 17 22:16:37.644044 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 544/1111] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:16:37 2022] GET /compute/v2.1/servers/120f12ef-0f38-41f4-a47d-2fdb6ffe8831 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:17:00.496360 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-47cc0cc8-7dbc-428a-b64e-4bf6f6313caf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:00.497300 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-47cc0cc8-7dbc-428a-b64e-4bf6f6313caf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:00.503463 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47cc0cc8-7dbc-428a-b64e-4bf6f6313caf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:00.503919 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47cc0cc8-7dbc-428a-b64e-4bf6f6313caf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:00.504701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47cc0cc8-7dbc-428a-b64e-4bf6f6313caf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:00.505142 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-47cc0cc8-7dbc-428a-b64e-4bf6f6313caf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:00.537655 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-47cc0cc8-7dbc-428a-b64e-4bf6f6313caf tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045645 May 17 22:17:00.538224 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 568/1112] 10.222.0.24 () {60 vars in 1342 bytes} [Tue May 17 22:17:00 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:17:00.599074 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d959f3e7-2e2a-4a21-a132-4e63f1275d9a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:00.599594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d959f3e7-2e2a-4a21-a132-4e63f1275d9a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:00.607286 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d959f3e7-2e2a-4a21-a132-4e63f1275d9a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:00.607958 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d959f3e7-2e2a-4a21-a132-4e63f1275d9a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:00.608739 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d959f3e7-2e2a-4a21-a132-4e63f1275d9a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:00.609177 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d959f3e7-2e2a-4a21-a132-4e63f1275d9a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:00.636727 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d959f3e7-2e2a-4a21-a132-4e63f1275d9a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Going to try to terminate instance {{(pid=117594) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:17:00.953469 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d959f3e7-2e2a-4a21-a132-4e63f1275d9a tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 204 len: 0 microversion: 2.20 time: 0.359187 May 17 22:17:00.954066 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 545/1113] 10.222.0.24 () {60 vars in 1279 bytes} [Tue May 17 22:17:00 2022] DELETE /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 22:17:00.963026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-81833358-35cd-418e-9a8f-1cae32036aba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:00.964653 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-81833358-35cd-418e-9a8f-1cae32036aba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:00.969549 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81833358-35cd-418e-9a8f-1cae32036aba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:00.970004 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81833358-35cd-418e-9a8f-1cae32036aba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:00.970774 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81833358-35cd-418e-9a8f-1cae32036aba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:00.971244 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-81833358-35cd-418e-9a8f-1cae32036aba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:01.133581 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-81833358-35cd-418e-9a8f-1cae32036aba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:01.146906 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-81833358-35cd-418e-9a8f-1cae32036aba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:01.149735 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-81833358-35cd-418e-9a8f-1cae32036aba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:01.151227 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-81833358-35cd-418e-9a8f-1cae32036aba tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.192674 May 17 22:17:01.152159 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 569/1114] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:17:00 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:17:02.173781 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c87e29ea-2972-4f7c-8860-ffa99a6f3416 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:02.175921 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c87e29ea-2972-4f7c-8860-ffa99a6f3416 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:02.182891 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c87e29ea-2972-4f7c-8860-ffa99a6f3416 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:02.183477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c87e29ea-2972-4f7c-8860-ffa99a6f3416 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:02.185081 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c87e29ea-2972-4f7c-8860-ffa99a6f3416 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:02.185792 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c87e29ea-2972-4f7c-8860-ffa99a6f3416 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:02.324932 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c87e29ea-2972-4f7c-8860-ffa99a6f3416 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:02.332838 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c87e29ea-2972-4f7c-8860-ffa99a6f3416 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:02.334365 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c87e29ea-2972-4f7c-8860-ffa99a6f3416 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:02.335589 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c87e29ea-2972-4f7c-8860-ffa99a6f3416 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1719 microversion: 2.20 time: 0.166433 May 17 22:17:02.336434 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 546/1115] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:17:02 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:17:03.356150 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a3d82b7b-ff4e-43d8-a30b-5eb702a39a47 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:03.356150 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a3d82b7b-ff4e-43d8-a30b-5eb702a39a47 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:03.366585 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3d82b7b-ff4e-43d8-a30b-5eb702a39a47 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:03.367097 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3d82b7b-ff4e-43d8-a30b-5eb702a39a47 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:03.368757 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3d82b7b-ff4e-43d8-a30b-5eb702a39a47 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:03.369206 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3d82b7b-ff4e-43d8-a30b-5eb702a39a47 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:03.414116 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-c3a848a1-ec40-4470-b0d4-b83e82e558ef req-3ccbbe09-a3b5-411e-be9f-2ee304e176ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c", "name": "network-vif-deleted", "tag": "01f9ff90-5b71-4555-bb92-f5d36e9518eb"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:17:03.427195 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-c3a848a1-ec40-4470-b0d4-b83e82e558ef req-3ccbbe09-a3b5-411e-be9f-2ee304e176ad service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:03.427966 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-c3a848a1-ec40-4470-b0d4-b83e82e558ef req-3ccbbe09-a3b5-411e-be9f-2ee304e176ad service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:03.451336 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-c3a848a1-ec40-4470-b0d4-b83e82e558ef req-3ccbbe09-a3b5-411e-be9f-2ee304e176ad service nova] Creating event network-vif-deleted:01f9ff90-5b71-4555-bb92-f5d36e9518eb for instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c on hv-cinder-83998 May 17 22:17:03.457244 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-c3a848a1-ec40-4470-b0d4-b83e82e558ef req-3ccbbe09-a3b5-411e-be9f-2ee304e176ad service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055603 May 17 22:17:03.458207 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 547/1116] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:17:03.470608 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a3d82b7b-ff4e-43d8-a30b-5eb702a39a47 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:03.479985 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a3d82b7b-ff4e-43d8-a30b-5eb702a39a47 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:03.481552 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a3d82b7b-ff4e-43d8-a30b-5eb702a39a47 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:03.482750 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a3d82b7b-ff4e-43d8-a30b-5eb702a39a47 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1652 microversion: 2.20 time: 0.132588 May 17 22:17:03.484048 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 570/1117] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:17:03 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1652 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:17:04.512276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:04.513036 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:04.525229 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:04.525687 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:04.527033 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:04.527033 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:04.568252 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:04.568960 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:04.569593 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lazy-loading 'fault' on Instance uuid 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:17:04.616649 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:04.626667 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:04.628465 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '532092f483874f05bc119211b9624492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '422158a05bcb44c8917cf1a6408cd7ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:04.629695 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d5ccd9aa-8d54-4037-84ad-c92ea78b6965 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 200 len: 1370 microversion: 2.20 time: 0.123036 May 17 22:17:04.630588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 548/1118] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:17:04 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 1370 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 22:17:05.647948 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-27cd058a-a8bd-439c-9539-3a260dc7cfb4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:05.648843 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-27cd058a-a8bd-439c-9539-3a260dc7cfb4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:05.655235 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-27cd058a-a8bd-439c-9539-3a260dc7cfb4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:05.655683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-27cd058a-a8bd-439c-9539-3a260dc7cfb4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:05.656556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-27cd058a-a8bd-439c-9539-3a260dc7cfb4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:05.656990 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-27cd058a-a8bd-439c-9539-3a260dc7cfb4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:05.672298 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-27cd058a-a8bd-439c-9539-3a260dc7cfb4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] HTTP exception thrown: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-27cd058a-a8bd-439c-9539-3a260dc7cfb4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Request method failure captured: May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c HTTP/1.1 May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0DBuUCDbUUBogi2Dmx9B174FuWcGKRf3wUJU9BKQh9667kNVTOc5RAippxlvprF2m97AlLO0tv0W9tFdb9_LMMXxMtlddDda75WXbt5zXMoyMrK28p8R1vEOz6-VOcgaSCsKOoK9kcESzPJTO8MxwXkcnNPoA3Mjkl_zHLlJukN8A May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Openstack-Nova-Api-Version: 2.20 May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 422158a05bcb44c8917cf1a6408cd7ad May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:17:05.673836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:17:05.675647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_422158a05bcb44c8917cf1a6408cd7ad", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:17:05.675647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:05.675647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 422158a05bcb44c8917cf1a6408cd7ad May 17 22:17:05.675647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:05.675647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeShelveTestJSON-1073204662-project May 17 22:17:05.675647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:17:05.675647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:17:05.675647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 532092f483874f05bc119211b9624492 May 17 22:17:05.675647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1073204662-project May 17 22:17:05.675647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:17:05.675647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:05.675647 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c'} May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:17:05.676745 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:05.678468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:05.683205 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-27cd058a-a8bd-439c-9539-3a260dc7cfb4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Returning 404 to user: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:17:05.683205 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-27cd058a-a8bd-439c-9539-3a260dc7cfb4 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 404 len: 111 microversion: 2.20 time: 0.031347 May 17 22:17:05.683205 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 571/1119] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:17:05 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 22:17:05.688063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-76f896fb-497a-4927-9732-73e64c477b29 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '.version_select at 0x7f09f204eb80>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:05.777700 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-76f896fb-497a-4927-9732-73e64c477b29 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-754303135" status: 204 len: 0 microversion: 2.20 time: 0.095194 May 17 22:17:05.778275 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 549/1120] 10.222.0.24 () {60 vars in 1258 bytes} [Tue May 17 22:17:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-754303135 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 17 22:17:07.932611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4a1151a2-a0be-4932-a97a-b2353158045d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:07.933104 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4a1151a2-a0be-4932-a97a-b2353158045d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:07.940027 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a1151a2-a0be-4932-a97a-b2353158045d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:07.940476 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a1151a2-a0be-4932-a97a-b2353158045d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:07.941251 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a1151a2-a0be-4932-a97a-b2353158045d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:07.941689 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4a1151a2-a0be-4932-a97a-b2353158045d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:07.955855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-4a1151a2-a0be-4932-a97a-b2353158045d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] HTTP exception thrown: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4a1151a2-a0be-4932-a97a-b2353158045d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Request method failure captured: May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: DELETE /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c HTTP/1.1 May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0DBuUCDbUUBogi2Dmx9B174FuWcGKRf3wUJU9BKQh9667kNVTOc5RAippxlvprF2m97AlLO0tv0W9tFdb9_LMMXxMtlddDda75WXbt5zXMoyMrK28p8R1vEOz6-VOcgaSCsKOoK9kcESzPJTO8MxwXkcnNPoA3Mjkl_zHLlJukN8A May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Openstack-Nova-Api-Version: 2.20 May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 422158a05bcb44c8917cf1a6408cd7ad May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:17:07.957431 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:17:07.959147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_422158a05bcb44c8917cf1a6408cd7ad", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:17:07.959147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:07.959147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 422158a05bcb44c8917cf1a6408cd7ad May 17 22:17:07.959147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:07.959147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeShelveTestJSON-1073204662-project May 17 22:17:07.959147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:17:07.959147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:17:07.959147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 532092f483874f05bc119211b9624492 May 17 22:17:07.959147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1073204662-project May 17 22:17:07.959147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:17:07.959147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:07.959147 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c'} May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:17:07.960209 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:07.962833 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:07.964390 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4a1151a2-a0be-4932-a97a-b2353158045d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Returning 404 to user: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:17:07.964390 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4a1151a2-a0be-4932-a97a-b2353158045d tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 404 len: 111 microversion: 2.20 time: 0.030135 May 17 22:17:07.964390 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 572/1121] 10.222.0.24 () {60 vars in 1279 bytes} [Tue May 17 22:17:07 2022] DELETE /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 22:17:07.968015 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a3217c8d-8278-42fe-9c4b-6fbe9ab63ee5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:07.968636 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a3217c8d-8278-42fe-9c4b-6fbe9ab63ee5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:07.975233 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3217c8d-8278-42fe-9c4b-6fbe9ab63ee5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:07.975682 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3217c8d-8278-42fe-9c4b-6fbe9ab63ee5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:07.976766 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3217c8d-8278-42fe-9c4b-6fbe9ab63ee5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:07.977201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a3217c8d-8278-42fe-9c4b-6fbe9ab63ee5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:07.990530 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-a3217c8d-8278-42fe-9c4b-6fbe9ab63ee5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] HTTP exception thrown: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a3217c8d-8278-42fe-9c4b-6fbe9ab63ee5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Request method failure captured: May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c HTTP/1.1 May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0DBuUCDbUUBogi2Dmx9B174FuWcGKRf3wUJU9BKQh9667kNVTOc5RAippxlvprF2m97AlLO0tv0W9tFdb9_LMMXxMtlddDda75WXbt5zXMoyMrK28p8R1vEOz6-VOcgaSCsKOoK9kcESzPJTO8MxwXkcnNPoA3Mjkl_zHLlJukN8A May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Openstack-Nova-Api-Version: 2.20 May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 422158a05bcb44c8917cf1a6408cd7ad May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:17:07.992408 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:17:07.994253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_422158a05bcb44c8917cf1a6408cd7ad", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:17:07.994253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:07.994253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 422158a05bcb44c8917cf1a6408cd7ad May 17 22:17:07.994253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:07.994253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-AttachVolumeShelveTestJSON-1073204662-project May 17 22:17:07.994253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:17:07.994253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:17:07.994253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 532092f483874f05bc119211b9624492 May 17 22:17:07.994253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1073204662-project May 17 22:17:07.994253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:17:07.994253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:07.994253 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c'} May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:17:07.995212 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. May 17 22:17:07.996728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:17:07.998045 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a3217c8d-8278-42fe-9c4b-6fbe9ab63ee5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Returning 404 to user: Instance 9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:17:07.998045 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a3217c8d-8278-42fe-9c4b-6fbe9ab63ee5 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c" status: 404 len: 111 microversion: 2.20 time: 0.029649 May 17 22:17:07.998045 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 550/1122] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:17:07 2022] GET /compute/v2.1/servers/9a17dcd3-764d-4b04-b3c1-d0cf3b3cf48c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 22:17:09.377144 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-07c9e26e-73ee-4973-bbcc-0d5b0b284848 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:09.377798 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-07c9e26e-73ee-4973-bbcc-0d5b0b284848 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:09.385048 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-07c9e26e-73ee-4973-bbcc-0d5b0b284848 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:09.385507 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-07c9e26e-73ee-4973-bbcc-0d5b0b284848 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:09.386534 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-07c9e26e-73ee-4973-bbcc-0d5b0b284848 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:09.387167 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-07c9e26e-73ee-4973-bbcc-0d5b0b284848 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:09.403034 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-07c9e26e-73ee-4973-bbcc-0d5b0b284848 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] HTTP exception thrown: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-07c9e26e-73ee-4973-bbcc-0d5b0b284848 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Request method failure captured: May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: DELETE /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e HTTP/1.1 May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB0DBuUCDbUUBogi2Dmx9B174FuWcGKRf3wUJU9BKQh9667kNVTOc5RAippxlvprF2m97AlLO0tv0W9tFdb9_LMMXxMtlddDda75WXbt5zXMoyMrK28p8R1vEOz6-VOcgaSCsKOoK9kcESzPJTO8MxwXkcnNPoA3Mjkl_zHLlJukN8A May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Openstack-Nova-Api-Version: 2.20 May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 422158a05bcb44c8917cf1a6408cd7ad May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:17:09.404692 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:17:09.406297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_422158a05bcb44c8917cf1a6408cd7ad", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:17:09.406297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:09.406297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 422158a05bcb44c8917cf1a6408cd7ad May 17 22:17:09.406297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:09.406297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-AttachVolumeShelveTestJSON-1073204662-project May 17 22:17:09.406297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:17:09.406297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:17:09.406297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 532092f483874f05bc119211b9624492 May 17 22:17:09.406297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1073204662-project May 17 22:17:09.406297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:17:09.406297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:17:09.406297 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '5c568a7b-6b45-45c4-b60a-3514d7c43e6e'} May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:17:09.407268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:17:09.408803 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:09.410304 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-07c9e26e-73ee-4973-bbcc-0d5b0b284848 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Returning 404 to user: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:17:09.410304 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-07c9e26e-73ee-4973-bbcc-0d5b0b284848 tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 404 len: 111 microversion: 2.20 time: 0.033024 May 17 22:17:09.410304 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 573/1123] 10.222.0.24 () {60 vars in 1279 bytes} [Tue May 17 22:17:09 2022] DELETE /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 22:17:09.418765 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7f1a6ac0-f6c6-4248-a300-e12bf30c20ea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:09.420017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7f1a6ac0-f6c6-4248-a300-e12bf30c20ea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] [instance: 5c568a7b-6b45-45c4-b60a-3514d7c43e6e] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:09.426282 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7f1a6ac0-f6c6-4248-a300-e12bf30c20ea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:09.426732 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7f1a6ac0-f6c6-4248-a300-e12bf30c20ea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:09.427604 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7f1a6ac0-f6c6-4248-a300-e12bf30c20ea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:09.428129 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7f1a6ac0-f6c6-4248-a300-e12bf30c20ea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:09.441953 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-7f1a6ac0-f6c6-4248-a300-e12bf30c20ea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] HTTP exception thrown: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7f1a6ac0-f6c6-4248-a300-e12bf30c20ea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Request method failure captured: May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e HTTP/1.1 May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB0DBuUCDbUUBogi2Dmx9B174FuWcGKRf3wUJU9BKQh9667kNVTOc5RAippxlvprF2m97AlLO0tv0W9tFdb9_LMMXxMtlddDda75WXbt5zXMoyMrK28p8R1vEOz6-VOcgaSCsKOoK9kcESzPJTO8MxwXkcnNPoA3Mjkl_zHLlJukN8A May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Openstack-Nova-Api-Version: 2.20 May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 422158a05bcb44c8917cf1a6408cd7ad May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:17:09.443515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:17:09.445711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_422158a05bcb44c8917cf1a6408cd7ad", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/422158a05bcb44c8917cf1a6408cd7ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:17:09.445711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:09.445711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 422158a05bcb44c8917cf1a6408cd7ad May 17 22:17:09.445711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1073204662 May 17 22:17:09.445711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-AttachVolumeShelveTestJSON-1073204662-project May 17 22:17:09.445711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:17:09.445711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:17:09.445711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 532092f483874f05bc119211b9624492 May 17 22:17:09.445711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1073204662-project May 17 22:17:09.445711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:17:09.445711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:17:09.445711 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '5c568a7b-6b45-45c4-b60a-3514d7c43e6e'} May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:17:09.446615 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. May 17 22:17:09.448051 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:17:09.449294 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7f1a6ac0-f6c6-4248-a300-e12bf30c20ea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] Returning 404 to user: Instance 5c568a7b-6b45-45c4-b60a-3514d7c43e6e could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:17:09.449294 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7f1a6ac0-f6c6-4248-a300-e12bf30c20ea tempest-AttachVolumeShelveTestJSON-1073204662 tempest-AttachVolumeShelveTestJSON-1073204662-project] 10.222.0.24 "GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e" status: 404 len: 111 microversion: 2.20 time: 0.029976 May 17 22:17:09.449294 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 551/1124] 10.222.0.24 () {60 vars in 1276 bytes} [Tue May 17 22:17:09 2022] GET /compute/v2.1/servers/5c568a7b-6b45-45c4-b60a-3514d7c43e6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 22:17:15.624423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6c024535-84f0-4bfb-9610-76afb54c4632 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] Action: 'create', calling method: .version_select at 0x7f09f218b4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1605508478", "metadata": {"Type": "work"}}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:17:16.364728 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6c024535-84f0-4bfb-9610-76afb54c4632 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.863243 May 17 22:17:16.365363 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 574/1125] 10.222.0.24 () {60 vars in 1155 bytes} [Tue May 17 22:17:15 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 865 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 17 22:17:16.376447 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-448cafad-6d12-4eb7-b4bd-70924a052906 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] Calling method '.version_select at 0x7f09f22ff0d0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:16.424837 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-448cafad-6d12-4eb7-b4bd-70924a052906 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82" status: 200 len: 353 microversion: 2.1 time: 0.052034 May 17 22:17:16.425559 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 552/1126] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:17:16 2022] GET /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:17:17.438752 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-59fd83b2-1322-41f6-b788-25885a2cf5e1 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] Calling method '.version_select at 0x7f09f2120430>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:17.489002 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-59fd83b2-1322-41f6-b788-25885a2cf5e1 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82" status: 200 len: 354 microversion: 2.1 time: 0.054913 May 17 22:17:17.493025 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 575/1127] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:17:17 2022] GET /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:17:17.501127 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9d5d020b-87ed-4d67-b33b-44dfd68f11e6 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] Calling method '.version_select at 0x7f09f204eaf0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:17.550705 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9d5d020b-87ed-4d67-b33b-44dfd68f11e6 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82" status: 200 len: 354 microversion: 2.1 time: 0.053879 May 17 22:17:17.551293 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 553/1128] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:17:17 2022] GET /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:17:17.567780 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6bbf957a-91d3-46b9-9d3d-fea37212ae83 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] Calling method '.version_select at 0x7f09f221fb80>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:17.802521 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6bbf957a-91d3-46b9-9d3d-fea37212ae83 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82" status: 202 len: 0 microversion: 2.1 time: 0.238478 May 17 22:17:17.803229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 576/1129] 10.222.0.24 () {58 vars in 1247 bytes} [Tue May 17 22:17:17 2022] DELETE /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:17:17.811780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0b8b7d0a-668c-4949-b9ba-2201ee2754dd tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] Calling method '.version_select at 0x7f09f22dbee0>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:17.856801 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0b8b7d0a-668c-4949-b9ba-2201ee2754dd tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82" status: 200 len: 353 microversion: 2.1 time: 0.048811 May 17 22:17:17.857351 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 554/1130] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:17:17 2022] GET /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:17:18.869802 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6d88748c-6ad6-4828-b04b-12d0a5233996 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] Calling method '.version_select at 0x7f09f2156310>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:18.896294 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-6d88748c-6ad6-4828-b04b-12d0a5233996 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] HTTP exception thrown: Volume 8371011c-dc22-4ea2-b851-9953f7316c82 could not be found. May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6d88748c-6ad6-4828-b04b-12d0a5233996 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] Request method failure captured: May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82 HTTP/1.1 May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB7rh1w9cjYV6aYc1fcKbRTionhXJHHKhDUIVdXqYrNtt0uuncQjDKUponpuw8ho6VrcbKqq0HgurWyaDBamd6U_jJx6kSaMn46-I9SDKkmjWumgSpKPrP-nGqOeK8ZXabbuVv5bv2PTwU1z7hctisUQ-DID5lhr9fLpTwAwaH6ZvLI May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 5fe81abec91245bfa2f58ac691f4acf0 May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-VolumesGetTestJSON-1843412242 May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:17:18.899174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5fe81abec91245bfa2f58ac691f4acf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5fe81abec91245bfa2f58ac691f4acf0", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5fe81abec91245bfa2f58ac691f4acf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5fe81abec91245bfa2f58ac691f4acf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-VolumesGetTestJSON-1843412242 May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 5fe81abec91245bfa2f58ac691f4acf0 May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-VolumesGetTestJSON-1843412242 May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-VolumesGetTestJSON-1843412242-project May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: a57d3e993a2d4dff84e372a061dcf3f8 May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-VolumesGetTestJSON-1843412242-project May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Volume 8371011c-dc22-4ea2-b851-9953f7316c82 could not be found. May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '8371011c-dc22-4ea2-b851-9953f7316c82'} May 17 22:17:18.900895 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8371011c-dc22-4ea2-b851-9953f7316c82 could not be found. (HTTP 404) (Request-ID: req-14334bf6-1797-482e-b712-f91633df1a94) May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:18.901994 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 22:17:18.906617 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8371011c-dc22-4ea2-b851-9953f7316c82 could not be found. May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 22:17:18.908580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8371011c-dc22-4ea2-b851-9953f7316c82 could not be found. May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8371011c-dc22-4ea2-b851-9953f7316c82 could not be found. May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6d88748c-6ad6-4828-b04b-12d0a5233996 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] Returning 404 to user: Volume 8371011c-dc22-4ea2-b851-9953f7316c82 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6d88748c-6ad6-4828-b04b-12d0a5233996 tempest-VolumesGetTestJSON-1843412242 tempest-VolumesGetTestJSON-1843412242-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82" status: 404 len: 109 microversion: 2.1 time: 0.035414 May 17 22:17:18.910001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 577/1131] 10.222.0.24 () {58 vars in 1244 bytes} [Tue May 17 22:17:18 2022] GET /compute/v2.1/os-volumes/8371011c-dc22-4ea2-b851-9953f7316c82 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:17:28.665516 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b1898cb5-3452-4de7-aa5d-5c490f1e357b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:17:28.666116 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b1898cb5-3452-4de7-aa5d-5c490f1e357b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:28.672441 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b1898cb5-3452-4de7-aa5d-5c490f1e357b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:28.672883 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b1898cb5-3452-4de7-aa5d-5c490f1e357b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:28.673631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b1898cb5-3452-4de7-aa5d-5c490f1e357b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:28.674064 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b1898cb5-3452-4de7-aa5d-5c490f1e357b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:28.696536 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-b1898cb5-3452-4de7-aa5d-5c490f1e357b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lazy-loading 'flavor' on Instance uuid 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:17:28.975366 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b1898cb5-3452-4de7-aa5d-5c490f1e357b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "POST /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2/action" status: 202 len: 0 microversion: 2.1 time: 0.313848 May 17 22:17:28.975938 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 555/1132] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:17:28 2022] POST /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:17:28.985386 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-70abd69b-a3a3-497b-8362-85dde80989e1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:28.986262 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-70abd69b-a3a3-497b-8362-85dde80989e1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:28.992137 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-70abd69b-a3a3-497b-8362-85dde80989e1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:28.992584 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-70abd69b-a3a3-497b-8362-85dde80989e1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:28.993351 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-70abd69b-a3a3-497b-8362-85dde80989e1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:28.993783 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-70abd69b-a3a3-497b-8362-85dde80989e1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:29.129539 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-70abd69b-a3a3-497b-8362-85dde80989e1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:29.136492 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-70abd69b-a3a3-497b-8362-85dde80989e1 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.155988 May 17 22:17:29.137047 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 578/1133] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:28 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:30.154922 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-94fadf94-b937-4403-95ec-72f8a6f02336 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:30.155670 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-94fadf94-b937-4403-95ec-72f8a6f02336 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:30.162339 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94fadf94-b937-4403-95ec-72f8a6f02336 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:30.162780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94fadf94-b937-4403-95ec-72f8a6f02336 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:30.163592 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94fadf94-b937-4403-95ec-72f8a6f02336 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:30.164034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-94fadf94-b937-4403-95ec-72f8a6f02336 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:30.293597 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-94fadf94-b937-4403-95ec-72f8a6f02336 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:30.301334 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-94fadf94-b937-4403-95ec-72f8a6f02336 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.150882 May 17 22:17:30.301900 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 556/1134] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:30 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:31.319249 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-866fcee7-417c-4121-bff1-55ce45737d26 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:31.319851 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-866fcee7-417c-4121-bff1-55ce45737d26 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:31.326587 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-866fcee7-417c-4121-bff1-55ce45737d26 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:31.327031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-866fcee7-417c-4121-bff1-55ce45737d26 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:31.327817 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-866fcee7-417c-4121-bff1-55ce45737d26 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:31.328248 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-866fcee7-417c-4121-bff1-55ce45737d26 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:31.471322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-866fcee7-417c-4121-bff1-55ce45737d26 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:31.478534 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-866fcee7-417c-4121-bff1-55ce45737d26 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.163215 May 17 22:17:31.479084 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 579/1135] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:31 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:32.496099 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8854e42d-ed22-4948-a686-a5103136c297 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:32.496702 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8854e42d-ed22-4948-a686-a5103136c297 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:32.503010 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8854e42d-ed22-4948-a686-a5103136c297 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:32.503487 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8854e42d-ed22-4948-a686-a5103136c297 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:32.504284 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8854e42d-ed22-4948-a686-a5103136c297 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:32.504732 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8854e42d-ed22-4948-a686-a5103136c297 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:32.641663 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8854e42d-ed22-4948-a686-a5103136c297 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:32.653949 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8854e42d-ed22-4948-a686-a5103136c297 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.162455 May 17 22:17:32.654918 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 557/1136] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:32 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:33.670770 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d208a944-2154-4536-b832-5bf2c931cada tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:33.671363 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d208a944-2154-4536-b832-5bf2c931cada tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:33.677652 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d208a944-2154-4536-b832-5bf2c931cada tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:33.678112 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d208a944-2154-4536-b832-5bf2c931cada tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:33.678864 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d208a944-2154-4536-b832-5bf2c931cada tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:33.679322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d208a944-2154-4536-b832-5bf2c931cada tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:33.815477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d208a944-2154-4536-b832-5bf2c931cada tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:33.822880 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d208a944-2154-4536-b832-5bf2c931cada tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.156281 May 17 22:17:33.824208 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 580/1137] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:33 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:34.841017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4ce5e687-51f5-4318-8ec8-a8999ed3c99b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:34.841652 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4ce5e687-51f5-4318-8ec8-a8999ed3c99b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:34.847714 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4ce5e687-51f5-4318-8ec8-a8999ed3c99b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:34.848166 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4ce5e687-51f5-4318-8ec8-a8999ed3c99b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:34.848997 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4ce5e687-51f5-4318-8ec8-a8999ed3c99b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:34.849428 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4ce5e687-51f5-4318-8ec8-a8999ed3c99b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:34.985462 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4ce5e687-51f5-4318-8ec8-a8999ed3c99b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:34.992913 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4ce5e687-51f5-4318-8ec8-a8999ed3c99b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.156433 May 17 22:17:34.993477 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 558/1138] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:34 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:36.010235 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-657d2fd5-e45c-4875-a102-18368e01a366 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:36.011609 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-657d2fd5-e45c-4875-a102-18368e01a366 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:36.017906 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-657d2fd5-e45c-4875-a102-18368e01a366 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:36.018550 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-657d2fd5-e45c-4875-a102-18368e01a366 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:36.019358 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-657d2fd5-e45c-4875-a102-18368e01a366 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:36.019787 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-657d2fd5-e45c-4875-a102-18368e01a366 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:36.150855 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-657d2fd5-e45c-4875-a102-18368e01a366 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:36.158466 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-657d2fd5-e45c-4875-a102-18368e01a366 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.152064 May 17 22:17:36.159014 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 581/1139] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:36 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:37.180521 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-62694087-1a25-43bb-808a-41b2b74c5364 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:37.181123 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-62694087-1a25-43bb-808a-41b2b74c5364 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:37.187749 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-62694087-1a25-43bb-808a-41b2b74c5364 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:37.188461 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-62694087-1a25-43bb-808a-41b2b74c5364 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:37.189280 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-62694087-1a25-43bb-808a-41b2b74c5364 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:37.189710 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-62694087-1a25-43bb-808a-41b2b74c5364 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:37.337387 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-62694087-1a25-43bb-808a-41b2b74c5364 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:37.344814 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-62694087-1a25-43bb-808a-41b2b74c5364 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.168250 May 17 22:17:37.345377 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 559/1140] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:37 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:17:38.361704 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b815e3ad-cc8b-45d1-82e5-d3d4e9aa498b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:38.362310 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b815e3ad-cc8b-45d1-82e5-d3d4e9aa498b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:38.368655 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b815e3ad-cc8b-45d1-82e5-d3d4e9aa498b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:38.369102 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b815e3ad-cc8b-45d1-82e5-d3d4e9aa498b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:38.370434 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b815e3ad-cc8b-45d1-82e5-d3d4e9aa498b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:38.371162 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b815e3ad-cc8b-45d1-82e5-d3d4e9aa498b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:38.502437 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b815e3ad-cc8b-45d1-82e5-d3d4e9aa498b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:38.510085 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b815e3ad-cc8b-45d1-82e5-d3d4e9aa498b tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.152182 May 17 22:17:38.511199 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 582/1141] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:38 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:39.533163 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8539ab72-5f44-4501-994c-104a4fac2625 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:39.533793 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8539ab72-5f44-4501-994c-104a4fac2625 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:39.540038 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8539ab72-5f44-4501-994c-104a4fac2625 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:39.540466 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8539ab72-5f44-4501-994c-104a4fac2625 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:39.541232 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8539ab72-5f44-4501-994c-104a4fac2625 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:39.541701 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8539ab72-5f44-4501-994c-104a4fac2625 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:39.671443 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8539ab72-5f44-4501-994c-104a4fac2625 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:39.679074 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8539ab72-5f44-4501-994c-104a4fac2625 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.149776 May 17 22:17:39.679675 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 560/1142] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:39 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:40.695982 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-eef59e9e-447d-4b54-bd0e-c238f2c7df16 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:40.696501 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-eef59e9e-447d-4b54-bd0e-c238f2c7df16 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:40.702978 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eef59e9e-447d-4b54-bd0e-c238f2c7df16 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:40.703529 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eef59e9e-447d-4b54-bd0e-c238f2c7df16 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:40.704289 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eef59e9e-447d-4b54-bd0e-c238f2c7df16 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:40.704726 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-eef59e9e-447d-4b54-bd0e-c238f2c7df16 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:40.835706 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-eef59e9e-447d-4b54-bd0e-c238f2c7df16 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:40.843225 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-eef59e9e-447d-4b54-bd0e-c238f2c7df16 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.151158 May 17 22:17:40.843778 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 583/1143] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:40 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:41.860721 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-50c1c94a-f138-469f-98e7-0ec405347df3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:41.861357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-50c1c94a-f138-469f-98e7-0ec405347df3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:41.867896 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50c1c94a-f138-469f-98e7-0ec405347df3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:41.868337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50c1c94a-f138-469f-98e7-0ec405347df3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:41.869104 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50c1c94a-f138-469f-98e7-0ec405347df3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:41.869531 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50c1c94a-f138-469f-98e7-0ec405347df3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:42.005442 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-50c1c94a-f138-469f-98e7-0ec405347df3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:42.013718 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-50c1c94a-f138-469f-98e7-0ec405347df3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.156882 May 17 22:17:42.014283 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 561/1144] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:41 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:43.030422 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2acf6563-697d-4a20-8cc0-0dd051af265c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:43.031257 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2acf6563-697d-4a20-8cc0-0dd051af265c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:43.037650 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2acf6563-697d-4a20-8cc0-0dd051af265c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:43.038105 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2acf6563-697d-4a20-8cc0-0dd051af265c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:43.038879 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2acf6563-697d-4a20-8cc0-0dd051af265c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:43.039348 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2acf6563-697d-4a20-8cc0-0dd051af265c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:43.182928 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2acf6563-697d-4a20-8cc0-0dd051af265c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:43.190408 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2acf6563-697d-4a20-8cc0-0dd051af265c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.164793 May 17 22:17:43.190999 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 584/1145] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:43 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:44.209132 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-137dfc8f-9420-4b93-b499-3fff2f9aa7fa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:44.209775 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-137dfc8f-9420-4b93-b499-3fff2f9aa7fa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:44.216685 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-137dfc8f-9420-4b93-b499-3fff2f9aa7fa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:44.217139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-137dfc8f-9420-4b93-b499-3fff2f9aa7fa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:44.217904 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-137dfc8f-9420-4b93-b499-3fff2f9aa7fa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:44.218337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-137dfc8f-9420-4b93-b499-3fff2f9aa7fa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:44.348122 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-137dfc8f-9420-4b93-b499-3fff2f9aa7fa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:44.356621 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-137dfc8f-9420-4b93-b499-3fff2f9aa7fa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.151369 May 17 22:17:44.357189 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 562/1146] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:44 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:45.374457 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9816a7c9-2bfb-4a72-a1a3-4c98aa327ae6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:45.375063 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9816a7c9-2bfb-4a72-a1a3-4c98aa327ae6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:45.381025 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9816a7c9-2bfb-4a72-a1a3-4c98aa327ae6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:45.381474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9816a7c9-2bfb-4a72-a1a3-4c98aa327ae6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:45.382241 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9816a7c9-2bfb-4a72-a1a3-4c98aa327ae6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:45.382675 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9816a7c9-2bfb-4a72-a1a3-4c98aa327ae6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:45.520327 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9816a7c9-2bfb-4a72-a1a3-4c98aa327ae6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:45.528477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9816a7c9-2bfb-4a72-a1a3-4c98aa327ae6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.158988 May 17 22:17:45.529086 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 585/1147] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:45 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:46.546435 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-66e53496-e9ba-4b30-a0ee-a1f60bb571aa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:46.547174 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-66e53496-e9ba-4b30-a0ee-a1f60bb571aa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:46.553539 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-66e53496-e9ba-4b30-a0ee-a1f60bb571aa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:46.553990 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-66e53496-e9ba-4b30-a0ee-a1f60bb571aa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:46.554750 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-66e53496-e9ba-4b30-a0ee-a1f60bb571aa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:46.555374 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-66e53496-e9ba-4b30-a0ee-a1f60bb571aa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:46.720231 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-66e53496-e9ba-4b30-a0ee-a1f60bb571aa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:46.728320 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-66e53496-e9ba-4b30-a0ee-a1f60bb571aa tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.186519 May 17 22:17:46.729426 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 563/1148] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:46 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:47.747693 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-b2e115d2-0ca6-4059-bd31-0085742a66c4 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:47.748430 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-b2e115d2-0ca6-4059-bd31-0085742a66c4 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:47.755322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b2e115d2-0ca6-4059-bd31-0085742a66c4 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:47.755846 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b2e115d2-0ca6-4059-bd31-0085742a66c4 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:47.756688 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b2e115d2-0ca6-4059-bd31-0085742a66c4 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:47.757208 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-b2e115d2-0ca6-4059-bd31-0085742a66c4 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:47.890004 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-b2e115d2-0ca6-4059-bd31-0085742a66c4 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:47.897618 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-b2e115d2-0ca6-4059-bd31-0085742a66c4 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.154752 May 17 22:17:47.898185 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 586/1149] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:47 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:48.915438 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b693cc62-1a0a-437c-b7ab-d628b8d3416d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:48.916049 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b693cc62-1a0a-437c-b7ab-d628b8d3416d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:48.922787 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b693cc62-1a0a-437c-b7ab-d628b8d3416d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:48.923262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b693cc62-1a0a-437c-b7ab-d628b8d3416d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:48.924039 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b693cc62-1a0a-437c-b7ab-d628b8d3416d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:48.924473 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b693cc62-1a0a-437c-b7ab-d628b8d3416d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:49.064563 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b693cc62-1a0a-437c-b7ab-d628b8d3416d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:49.071888 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b693cc62-1a0a-437c-b7ab-d628b8d3416d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.160375 May 17 22:17:49.072793 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 564/1150] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:48 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:50.088755 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-004a8580-d2c4-44c4-a631-0962c83bb8d8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:50.089660 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-004a8580-d2c4-44c4-a631-0962c83bb8d8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:50.096007 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-004a8580-d2c4-44c4-a631-0962c83bb8d8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:50.096453 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-004a8580-d2c4-44c4-a631-0962c83bb8d8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:50.097210 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-004a8580-d2c4-44c4-a631-0962c83bb8d8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:50.097640 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-004a8580-d2c4-44c4-a631-0962c83bb8d8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:50.233580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-004a8580-d2c4-44c4-a631-0962c83bb8d8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:50.240982 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-004a8580-d2c4-44c4-a631-0962c83bb8d8 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.156568 May 17 22:17:50.241740 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 587/1151] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:50 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:51.266185 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ef4214c5-7135-46d6-8eef-add1a09e7327 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:51.266845 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ef4214c5-7135-46d6-8eef-add1a09e7327 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:51.273588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ef4214c5-7135-46d6-8eef-add1a09e7327 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:51.274029 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ef4214c5-7135-46d6-8eef-add1a09e7327 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:51.274809 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ef4214c5-7135-46d6-8eef-add1a09e7327 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:51.275272 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ef4214c5-7135-46d6-8eef-add1a09e7327 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:51.409716 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ef4214c5-7135-46d6-8eef-add1a09e7327 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:51.418242 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ef4214c5-7135-46d6-8eef-add1a09e7327 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.156429 May 17 22:17:51.418809 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 565/1152] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:51 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:52.435981 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-02d570cc-5713-434a-8260-b2797fc32000 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:52.436596 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-02d570cc-5713-434a-8260-b2797fc32000 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:52.443265 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-02d570cc-5713-434a-8260-b2797fc32000 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:52.446359 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-02d570cc-5713-434a-8260-b2797fc32000 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:52.446359 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-02d570cc-5713-434a-8260-b2797fc32000 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:52.446359 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-02d570cc-5713-434a-8260-b2797fc32000 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:52.583631 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-02d570cc-5713-434a-8260-b2797fc32000 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:52.591393 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-02d570cc-5713-434a-8260-b2797fc32000 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1568 microversion: 2.1 time: 0.159956 May 17 22:17:52.591967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 588/1153] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:52 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:52.607717 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b8f18a1b-9442-421e-8de9-2bdd3ce852e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:17:52.608321 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b8f18a1b-9442-421e-8de9-2bdd3ce852e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:52.614295 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8f18a1b-9442-421e-8de9-2bdd3ce852e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:52.614765 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8f18a1b-9442-421e-8de9-2bdd3ce852e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:52.615582 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8f18a1b-9442-421e-8de9-2bdd3ce852e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:52.616017 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b8f18a1b-9442-421e-8de9-2bdd3ce852e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:52.920662 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b8f18a1b-9442-421e-8de9-2bdd3ce852e3 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "POST /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2/action" status: 202 len: 0 microversion: 2.1 time: 0.316999 May 17 22:17:52.921629 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 566/1154] 10.222.0.24 () {60 vars in 1277 bytes} [Tue May 17 22:17:52 2022] POST /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:17:52.930953 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d04dc7b0-036f-4c20-a19e-ffd714b88444 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:52.931211 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d04dc7b0-036f-4c20-a19e-ffd714b88444 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:52.942463 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d04dc7b0-036f-4c20-a19e-ffd714b88444 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:52.942891 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d04dc7b0-036f-4c20-a19e-ffd714b88444 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:52.943893 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d04dc7b0-036f-4c20-a19e-ffd714b88444 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:52.944524 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d04dc7b0-036f-4c20-a19e-ffd714b88444 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:53.083066 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d04dc7b0-036f-4c20-a19e-ffd714b88444 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:53.091223 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d04dc7b0-036f-4c20-a19e-ffd714b88444 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1516 microversion: 2.1 time: 0.163935 May 17 22:17:53.091346 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 589/1155] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:52 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:54.109557 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dbf8d38f-9f7f-4f42-9c05-9ac64fec04b7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:54.110759 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dbf8d38f-9f7f-4f42-9c05-9ac64fec04b7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:54.118206 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbf8d38f-9f7f-4f42-9c05-9ac64fec04b7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:54.118652 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbf8d38f-9f7f-4f42-9c05-9ac64fec04b7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:54.120022 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbf8d38f-9f7f-4f42-9c05-9ac64fec04b7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:54.120617 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-dbf8d38f-9f7f-4f42-9c05-9ac64fec04b7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:54.251814 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dbf8d38f-9f7f-4f42-9c05-9ac64fec04b7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:54.259313 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dbf8d38f-9f7f-4f42-9c05-9ac64fec04b7 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1516 microversion: 2.1 time: 0.154231 May 17 22:17:54.259832 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 567/1156] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:54 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:54.579353 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-470f5b9c-28b7-448c-b499-3f22ccc28973 req-400c0897-9547-4303-a787-8dd7dd598ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fe4fe4-16e9-4a9d-a0cf-954d520222c2", "name": "network-vif-unplugged", "status": "completed", "tag": "9c8d665a-b5a0-45a4-a0ba-7f36817e2db3"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:17:54.590096 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-470f5b9c-28b7-448c-b499-3f22ccc28973 req-400c0897-9547-4303-a787-8dd7dd598ecf service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:54.591680 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-470f5b9c-28b7-448c-b499-3f22ccc28973 req-400c0897-9547-4303-a787-8dd7dd598ecf service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:54.604242 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.compute.server_external_events [req-470f5b9c-28b7-448c-b499-3f22ccc28973 req-400c0897-9547-4303-a787-8dd7dd598ecf service nova] Unable to find a host for instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2. Dropping event network-vif-unplugged {{(pid=117593) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 17 22:17:54.605899 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-470f5b9c-28b7-448c-b499-3f22ccc28973 req-400c0897-9547-4303-a787-8dd7dd598ecf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030605 May 17 22:17:54.609112 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 590/1157] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 17 22:17:55.277307 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8f1582e3-60ad-4d59-ac22-0dd4f291f016 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:55.277907 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8f1582e3-60ad-4d59-ac22-0dd4f291f016 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:55.284867 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f1582e3-60ad-4d59-ac22-0dd4f291f016 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:55.284867 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f1582e3-60ad-4d59-ac22-0dd4f291f016 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:55.285492 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f1582e3-60ad-4d59-ac22-0dd4f291f016 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:55.285952 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8f1582e3-60ad-4d59-ac22-0dd4f291f016 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:55.433821 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8f1582e3-60ad-4d59-ac22-0dd4f291f016 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:55.441780 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8f1582e3-60ad-4d59-ac22-0dd4f291f016 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1518 microversion: 2.1 time: 0.168710 May 17 22:17:55.442577 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 568/1158] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:55 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:56.459849 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ffa10c31-016d-4b7e-af15-64f39648b425 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:56.460381 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ffa10c31-016d-4b7e-af15-64f39648b425 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:56.467317 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ffa10c31-016d-4b7e-af15-64f39648b425 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:56.467763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ffa10c31-016d-4b7e-af15-64f39648b425 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:56.468550 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ffa10c31-016d-4b7e-af15-64f39648b425 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:56.468978 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ffa10c31-016d-4b7e-af15-64f39648b425 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:56.601005 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ffa10c31-016d-4b7e-af15-64f39648b425 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:56.608999 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ffa10c31-016d-4b7e-af15-64f39648b425 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1574 microversion: 2.1 time: 0.153017 May 17 22:17:56.609594 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 591/1159] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:56 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:57.625797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-4b977510-9962-42f9-be34-b0570e7cff2e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:57.626402 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-4b977510-9962-42f9-be34-b0570e7cff2e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:57.632682 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4b977510-9962-42f9-be34-b0570e7cff2e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:57.633133 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4b977510-9962-42f9-be34-b0570e7cff2e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:57.633911 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4b977510-9962-42f9-be34-b0570e7cff2e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:57.634340 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-4b977510-9962-42f9-be34-b0570e7cff2e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:57.764641 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-4b977510-9962-42f9-be34-b0570e7cff2e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:57.771933 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-4b977510-9962-42f9-be34-b0570e7cff2e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1574 microversion: 2.1 time: 0.150001 May 17 22:17:57.772553 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 569/1160] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:57 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:17:58.788854 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2f7ddda8-0cf7-463f-a1bc-e24eb1b289de tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:17:58.790060 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2f7ddda8-0cf7-463f-a1bc-e24eb1b289de tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:17:58.796254 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2f7ddda8-0cf7-463f-a1bc-e24eb1b289de tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:58.796702 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2f7ddda8-0cf7-463f-a1bc-e24eb1b289de tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:58.797467 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2f7ddda8-0cf7-463f-a1bc-e24eb1b289de tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:17:58.797901 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2f7ddda8-0cf7-463f-a1bc-e24eb1b289de tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:17:58.925814 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2f7ddda8-0cf7-463f-a1bc-e24eb1b289de tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:17:58.933772 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2f7ddda8-0cf7-463f-a1bc-e24eb1b289de tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1574 microversion: 2.1 time: 0.148787 May 17 22:17:58.934546 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 592/1161] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:17:58 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:00.005227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c2301e87-71ac-475d-b42e-3178250382f5 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:00.005814 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c2301e87-71ac-475d-b42e-3178250382f5 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:00.013550 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c2301e87-71ac-475d-b42e-3178250382f5 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:00.014326 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c2301e87-71ac-475d-b42e-3178250382f5 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:00.015705 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c2301e87-71ac-475d-b42e-3178250382f5 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:00.016495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c2301e87-71ac-475d-b42e-3178250382f5 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:00.146817 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-c2301e87-71ac-475d-b42e-3178250382f5 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:00.155239 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c2301e87-71ac-475d-b42e-3178250382f5 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1574 microversion: 2.1 time: 0.153845 May 17 22:18:00.155797 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 570/1162] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:00 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:01.172371 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c30eabc5-59b5-4fee-9b0e-f7ca426b2e9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:01.172909 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c30eabc5-59b5-4fee-9b0e-f7ca426b2e9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:01.179245 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c30eabc5-59b5-4fee-9b0e-f7ca426b2e9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:01.179699 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c30eabc5-59b5-4fee-9b0e-f7ca426b2e9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:01.180470 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c30eabc5-59b5-4fee-9b0e-f7ca426b2e9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:01.180913 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c30eabc5-59b5-4fee-9b0e-f7ca426b2e9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:01.311129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c30eabc5-59b5-4fee-9b0e-f7ca426b2e9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:01.319062 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c30eabc5-59b5-4fee-9b0e-f7ca426b2e9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1574 microversion: 2.1 time: 0.150645 May 17 22:18:01.319866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 593/1163] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:01 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:02.336562 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-7ccad8d6-c1f8-47a0-9e3b-05d1494389e6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:02.337164 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-7ccad8d6-c1f8-47a0-9e3b-05d1494389e6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:02.344026 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7ccad8d6-c1f8-47a0-9e3b-05d1494389e6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:02.344473 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7ccad8d6-c1f8-47a0-9e3b-05d1494389e6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:02.345243 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7ccad8d6-c1f8-47a0-9e3b-05d1494389e6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:02.345675 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-7ccad8d6-c1f8-47a0-9e3b-05d1494389e6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:02.477107 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-7ccad8d6-c1f8-47a0-9e3b-05d1494389e6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:02.484518 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-7ccad8d6-c1f8-47a0-9e3b-05d1494389e6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1574 microversion: 2.1 time: 0.152045 May 17 22:18:02.485089 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 571/1164] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:02 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:03.501521 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-11213269-17a6-4a7a-846c-32a525cc9e9a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:03.502322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-11213269-17a6-4a7a-846c-32a525cc9e9a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:03.508894 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11213269-17a6-4a7a-846c-32a525cc9e9a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:03.509344 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11213269-17a6-4a7a-846c-32a525cc9e9a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:03.510315 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11213269-17a6-4a7a-846c-32a525cc9e9a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:03.510761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-11213269-17a6-4a7a-846c-32a525cc9e9a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:03.643170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-11213269-17a6-4a7a-846c-32a525cc9e9a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:03.651287 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-11213269-17a6-4a7a-846c-32a525cc9e9a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1574 microversion: 2.1 time: 0.153098 May 17 22:18:03.651921 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 594/1165] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:03 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:04.668778 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a36ad5a0-f1bc-4cd5-9333-e31fe301603a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:04.669374 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a36ad5a0-f1bc-4cd5-9333-e31fe301603a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:04.675331 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a36ad5a0-f1bc-4cd5-9333-e31fe301603a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:04.676100 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a36ad5a0-f1bc-4cd5-9333-e31fe301603a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:04.676518 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a36ad5a0-f1bc-4cd5-9333-e31fe301603a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:04.676948 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a36ad5a0-f1bc-4cd5-9333-e31fe301603a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:04.811453 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a36ad5a0-f1bc-4cd5-9333-e31fe301603a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:04.819313 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a36ad5a0-f1bc-4cd5-9333-e31fe301603a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1574 microversion: 2.1 time: 0.154875 May 17 22:18:04.819885 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 572/1166] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:04 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:05.836758 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d44c15a4-5a0f-4fd1-85b8-5e0835d53d9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:05.844325 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d44c15a4-5a0f-4fd1-85b8-5e0835d53d9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:05.852754 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d44c15a4-5a0f-4fd1-85b8-5e0835d53d9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:05.853880 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d44c15a4-5a0f-4fd1-85b8-5e0835d53d9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:05.854665 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d44c15a4-5a0f-4fd1-85b8-5e0835d53d9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:05.855097 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d44c15a4-5a0f-4fd1-85b8-5e0835d53d9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:06.013001 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d44c15a4-5a0f-4fd1-85b8-5e0835d53d9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:06.018379 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d44c15a4-5a0f-4fd1-85b8-5e0835d53d9c tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1574 microversion: 2.1 time: 0.185526 May 17 22:18:06.018941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 595/1167] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:05 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:06.709063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-de71c1f0-0071-4d81-aca2-393b4f4f8326 req-7df7f808-726e-4346-8607-0bfb45f568d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fe4fe4-16e9-4a9d-a0cf-954d520222c2", "name": "network-vif-plugged", "status": "completed", "tag": "9c8d665a-b5a0-45a4-a0ba-7f36817e2db3"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:18:06.718134 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-de71c1f0-0071-4d81-aca2-393b4f4f8326 req-7df7f808-726e-4346-8607-0bfb45f568d8 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:06.718579 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-de71c1f0-0071-4d81-aca2-393b4f4f8326 req-7df7f808-726e-4346-8607-0bfb45f568d8 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:06.730843 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-de71c1f0-0071-4d81-aca2-393b4f4f8326 req-7df7f808-726e-4346-8607-0bfb45f568d8 service nova] Creating event network-vif-plugged:9c8d665a-b5a0-45a4-a0ba-7f36817e2db3 for instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 on hv-cinder-83998 May 17 22:18:06.735973 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-de71c1f0-0071-4d81-aca2-393b4f4f8326 req-7df7f808-726e-4346-8607-0bfb45f568d8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030629 May 17 22:18:06.737439 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 573/1168] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:18:07.036311 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2e65d983-9175-4b86-98a6-5dea21220d76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:07.036917 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2e65d983-9175-4b86-98a6-5dea21220d76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:07.043277 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2e65d983-9175-4b86-98a6-5dea21220d76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:07.043737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2e65d983-9175-4b86-98a6-5dea21220d76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:07.044513 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2e65d983-9175-4b86-98a6-5dea21220d76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:07.044947 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2e65d983-9175-4b86-98a6-5dea21220d76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:07.177680 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2e65d983-9175-4b86-98a6-5dea21220d76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:07.188688 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2e65d983-9175-4b86-98a6-5dea21220d76 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1574 microversion: 2.1 time: 0.155558 May 17 22:18:07.189767 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 596/1169] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:07 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:08.207852 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-8afde3c6-08e5-4713-ac30-6eee19f28194 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:08.208472 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-8afde3c6-08e5-4713-ac30-6eee19f28194 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:08.215575 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8afde3c6-08e5-4713-ac30-6eee19f28194 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:08.216020 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8afde3c6-08e5-4713-ac30-6eee19f28194 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:08.216784 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8afde3c6-08e5-4713-ac30-6eee19f28194 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:08.217218 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-8afde3c6-08e5-4713-ac30-6eee19f28194 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:08.357025 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-8afde3c6-08e5-4713-ac30-6eee19f28194 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:08.365982 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-8afde3c6-08e5-4713-ac30-6eee19f28194 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1561 microversion: 2.1 time: 0.160884 May 17 22:18:08.365982 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 574/1170] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:08 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:29.074184 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-68dfe3e4-aae5-4216-ad82-476fd6702047 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Action: 'create', calling method: .version_select at 0x7f09f21a4ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1523709044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgLSrivzqlvJZN1EKoMi0x5aTQeRb9BiQrtIVhQ5RNiQtpz+hnBb1XeBmhkkBXetTgb0UzkK36eFB/bC3pyEW7eAFy7/1KtZtTO/dnQR4odHyKEDoLUl8CWRncnFP6jFQ=="}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:18:29.089975 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-68dfe3e4-aae5-4216-ad82-476fd6702047 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Getting quotas for project 3cf34ac8db96460ba3b25bfe4aa0680c. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:18:29.094339 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-68dfe3e4-aae5-4216-ad82-476fd6702047 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Getting quotas for user 4c4de421a8224e89ab11a2a2d88f0315 and project 3cf34ac8db96460ba3b25bfe4aa0680c. Resources: {'key_pairs'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:18:29.107947 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR oslo.messaging._drivers.impl_rabbit [None req-68dfe3e4-aae5-4216-ad82-476fd6702047 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [abacf971-17ca-41b9-aab2-16be993e2ef6] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 22:18:30.115080 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [None req-68dfe3e4-aae5-4216-ad82-476fd6702047 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [abacf971-17ca-41b9-aab2-16be993e2ef6] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 50338. May 17 22:18:30.187017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-68dfe3e4-aae5-4216-ad82-476fd6702047 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.299269 May 17 22:18:30.187652 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 597/1171] 10.222.0.24 () {60 vars in 1158 bytes} [Tue May 17 22:18:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:18:48.497751 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1259357936", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1523709044", "security_groups": [{"name": "tempest-secgroup-smoke-1817986569"}], "block_device_mapping_v2": [{"uuid": "f318eec5-92a2-4122-a704-25744fe83f23", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4473d761-85c9-4726-8a15-f941841bf909"}]}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:18:48.618099 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] validate_networks() for [('4473d761-85c9-4726-8a15-f941841bf909', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:18:48.972433 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:18:48.972850 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:18:48.973315 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:18:48.973845 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:18:48.974282 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:18:48.983733 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:48.986859 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:48.986859 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:48.986859 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:49.002645 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Getting quotas for project 3cf34ac8db96460ba3b25bfe4aa0680c. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:18:49.006610 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Getting quotas for user 4c4de421a8224e89ab11a2a2d88f0315 and project 3cf34ac8db96460ba3b25bfe4aa0680c. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:18:49.062821 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:18:49.065313 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f318eec5-92a2-4122-a704-25744fe83f23',volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:18:49.518097 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-c3897f0a-57c8-4624-a56f-51a326963c48 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.024342 May 17 22:18:49.518912 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 575/1172] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:18:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:18:49.530814 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-47a8ad4f-3a28-4445-895b-c6a6d06f4da5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:49.531471 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-47a8ad4f-3a28-4445-895b-c6a6d06f4da5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:49.588756 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-47a8ad4f-3a28-4445-895b-c6a6d06f4da5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:49.595393 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-47a8ad4f-3a28-4445-895b-c6a6d06f4da5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1095 microversion: 2.1 time: 0.069170 May 17 22:18:49.595977 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 598/1173] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:49 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:50.613531 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-0fe6ca6b-dc7c-4c14-8492-0bd5738faa1a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:50.614093 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-0fe6ca6b-dc7c-4c14-8492-0bd5738faa1a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:50.620363 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0fe6ca6b-dc7c-4c14-8492-0bd5738faa1a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:50.620813 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0fe6ca6b-dc7c-4c14-8492-0bd5738faa1a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:50.621623 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0fe6ca6b-dc7c-4c14-8492-0bd5738faa1a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:50.622083 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-0fe6ca6b-dc7c-4c14-8492-0bd5738faa1a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:50.685184 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-0fe6ca6b-dc7c-4c14-8492-0bd5738faa1a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:50.692799 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-0fe6ca6b-dc7c-4c14-8492-0bd5738faa1a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1145 microversion: 2.1 time: 0.084335 May 17 22:18:50.693363 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 576/1174] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:50 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:51.709884 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a3e15b06-f727-45e3-ab88-5ebae9b681b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:51.710490 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a3e15b06-f727-45e3-ab88-5ebae9b681b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:51.718311 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3e15b06-f727-45e3-ab88-5ebae9b681b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:51.718758 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3e15b06-f727-45e3-ab88-5ebae9b681b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:51.719597 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3e15b06-f727-45e3-ab88-5ebae9b681b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:51.720028 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a3e15b06-f727-45e3-ab88-5ebae9b681b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:51.794325 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a3e15b06-f727-45e3-ab88-5ebae9b681b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:51.801649 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a3e15b06-f727-45e3-ab88-5ebae9b681b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1201 microversion: 2.1 time: 0.095657 May 17 22:18:51.802215 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 599/1175] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:51 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:52.818990 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-73e8116d-46ec-4f90-aa7f-11861688e367 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:52.819759 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-73e8116d-46ec-4f90-aa7f-11861688e367 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:52.832469 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73e8116d-46ec-4f90-aa7f-11861688e367 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:52.832469 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73e8116d-46ec-4f90-aa7f-11861688e367 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:52.832469 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73e8116d-46ec-4f90-aa7f-11861688e367 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:52.832469 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-73e8116d-46ec-4f90-aa7f-11861688e367 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:53.002966 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-73e8116d-46ec-4f90-aa7f-11861688e367 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:53.010743 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-73e8116d-46ec-4f90-aa7f-11861688e367 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1279 microversion: 2.1 time: 0.195712 May 17 22:18:53.011329 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 577/1176] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:52 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1279 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:18:53.471739 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-72f1fc32-963d-4628-999c-e236cb2882a2 req-8372d897-f779-4d9c-8e32-a3c19e091911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b13b97f7-9d11-48f9-8cab-88dde91e34da", "tag": "aef37fd5-f4d9-4f6b-819b-ec2dd17475c3"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:18:53.480501 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-72f1fc32-963d-4628-999c-e236cb2882a2 req-8372d897-f779-4d9c-8e32-a3c19e091911 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:53.481030 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-72f1fc32-963d-4628-999c-e236cb2882a2 req-8372d897-f779-4d9c-8e32-a3c19e091911 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:53.496503 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-72f1fc32-963d-4628-999c-e236cb2882a2 req-8372d897-f779-4d9c-8e32-a3c19e091911 service nova] Creating event network-changed:aef37fd5-f4d9-4f6b-819b-ec2dd17475c3 for instance b13b97f7-9d11-48f9-8cab-88dde91e34da on hv-cinder-83998 May 17 22:18:53.499027 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR oslo.messaging._drivers.impl_rabbit [req-72f1fc32-963d-4628-999c-e236cb2882a2 req-8372d897-f779-4d9c-8e32-a3c19e091911 service nova] [3cd48a75-971d-447a-a8c5-f29728e9cd84] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 22:18:54.028563 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6d5d6452-1ba2-420c-9e40-b9575a5bfbbf tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:54.029111 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6d5d6452-1ba2-420c-9e40-b9575a5bfbbf tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:54.035358 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d5d6452-1ba2-420c-9e40-b9575a5bfbbf tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:54.035812 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d5d6452-1ba2-420c-9e40-b9575a5bfbbf tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:54.036579 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d5d6452-1ba2-420c-9e40-b9575a5bfbbf tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:54.037015 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d5d6452-1ba2-420c-9e40-b9575a5bfbbf tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:54.164602 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6d5d6452-1ba2-420c-9e40-b9575a5bfbbf tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:54.171949 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6d5d6452-1ba2-420c-9e40-b9575a5bfbbf tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1267 microversion: 2.1 time: 0.147974 May 17 22:18:54.172785 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 578/1177] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:54 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:18:54.506299 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [req-72f1fc32-963d-4628-999c-e236cb2882a2 req-8372d897-f779-4d9c-8e32-a3c19e091911 service nova] [3cd48a75-971d-447a-a8c5-f29728e9cd84] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 50494. May 17 22:18:54.510689 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-72f1fc32-963d-4628-999c-e236cb2882a2 req-8372d897-f779-4d9c-8e32-a3c19e091911 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.042937 May 17 22:18:54.511374 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 600/1178] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:18:55.189494 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6f7d9680-a131-44f0-903b-b311f234cf9a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:55.190139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6f7d9680-a131-44f0-903b-b311f234cf9a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:55.196726 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f7d9680-a131-44f0-903b-b311f234cf9a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:55.197166 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f7d9680-a131-44f0-903b-b311f234cf9a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:55.197933 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f7d9680-a131-44f0-903b-b311f234cf9a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:55.198362 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f7d9680-a131-44f0-903b-b311f234cf9a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:55.326387 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6f7d9680-a131-44f0-903b-b311f234cf9a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:55.333644 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6f7d9680-a131-44f0-903b-b311f234cf9a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1267 microversion: 2.1 time: 0.148375 May 17 22:18:55.334209 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 579/1179] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:55 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:56.351953 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7c77bde6-8442-4e3e-883d-cc8a59be4d81 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:56.353272 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7c77bde6-8442-4e3e-883d-cc8a59be4d81 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:56.359495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c77bde6-8442-4e3e-883d-cc8a59be4d81 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:56.359940 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c77bde6-8442-4e3e-883d-cc8a59be4d81 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:56.360941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c77bde6-8442-4e3e-883d-cc8a59be4d81 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:56.361375 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c77bde6-8442-4e3e-883d-cc8a59be4d81 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:56.499432 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c77bde6-8442-4e3e-883d-cc8a59be4d81 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:56.506616 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7c77bde6-8442-4e3e-883d-cc8a59be4d81 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1267 microversion: 2.1 time: 0.159366 May 17 22:18:56.507173 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 601/1180] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:56 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:18:57.523578 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-303f628d-b60f-4de2-8f6e-52339b8f200a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:57.524231 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-303f628d-b60f-4de2-8f6e-52339b8f200a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:57.531597 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-303f628d-b60f-4de2-8f6e-52339b8f200a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:57.532043 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-303f628d-b60f-4de2-8f6e-52339b8f200a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:57.532811 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-303f628d-b60f-4de2-8f6e-52339b8f200a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:57.533249 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-303f628d-b60f-4de2-8f6e-52339b8f200a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:57.660438 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-303f628d-b60f-4de2-8f6e-52339b8f200a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:57.668534 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-303f628d-b60f-4de2-8f6e-52339b8f200a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1267 microversion: 2.1 time: 0.148800 May 17 22:18:57.669376 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 580/1181] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:57 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:58.690964 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-05701857-f21e-4532-bec9-4dfa2c4be4b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:58.691556 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-05701857-f21e-4532-bec9-4dfa2c4be4b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:58.698577 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-05701857-f21e-4532-bec9-4dfa2c4be4b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:58.699013 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-05701857-f21e-4532-bec9-4dfa2c4be4b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:58.699800 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-05701857-f21e-4532-bec9-4dfa2c4be4b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:58.700235 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-05701857-f21e-4532-bec9-4dfa2c4be4b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:58.832568 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-05701857-f21e-4532-bec9-4dfa2c4be4b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:18:58.840585 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-05701857-f21e-4532-bec9-4dfa2c4be4b1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1267 microversion: 2.1 time: 0.153960 May 17 22:18:58.841152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 602/1182] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:58 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:18:59.858151 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5e708d61-ad1d-4a1f-9df5-c9030bfb9fe9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:18:59.858792 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5e708d61-ad1d-4a1f-9df5-c9030bfb9fe9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:18:59.864992 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e708d61-ad1d-4a1f-9df5-c9030bfb9fe9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:59.865430 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e708d61-ad1d-4a1f-9df5-c9030bfb9fe9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:18:59.866188 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e708d61-ad1d-4a1f-9df5-c9030bfb9fe9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:18:59.866701 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5e708d61-ad1d-4a1f-9df5-c9030bfb9fe9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:00.001954 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5e708d61-ad1d-4a1f-9df5-c9030bfb9fe9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:00.009161 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5e708d61-ad1d-4a1f-9df5-c9030bfb9fe9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1267 microversion: 2.1 time: 0.154883 May 17 22:19:00.009709 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 581/1183] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:18:59 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:01.026357 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f8a0a9b5-623d-4144-8962-2e08451dd001 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:01.027177 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f8a0a9b5-623d-4144-8962-2e08451dd001 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:01.033708 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f8a0a9b5-623d-4144-8962-2e08451dd001 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:01.034156 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f8a0a9b5-623d-4144-8962-2e08451dd001 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:01.034926 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f8a0a9b5-623d-4144-8962-2e08451dd001 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:01.035388 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f8a0a9b5-623d-4144-8962-2e08451dd001 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:01.225760 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f8a0a9b5-623d-4144-8962-2e08451dd001 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:01.233424 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f8a0a9b5-623d-4144-8962-2e08451dd001 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1267 microversion: 2.1 time: 0.211535 May 17 22:19:01.233988 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 603/1184] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:01 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:02.249990 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1758e2f1-51c4-4f35-a874-0f693ee178c5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:02.250548 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1758e2f1-51c4-4f35-a874-0f693ee178c5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:02.256952 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1758e2f1-51c4-4f35-a874-0f693ee178c5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:02.257403 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1758e2f1-51c4-4f35-a874-0f693ee178c5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:02.258177 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1758e2f1-51c4-4f35-a874-0f693ee178c5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:02.258616 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1758e2f1-51c4-4f35-a874-0f693ee178c5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:02.386024 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1758e2f1-51c4-4f35-a874-0f693ee178c5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:02.393329 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1758e2f1-51c4-4f35-a874-0f693ee178c5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1267 microversion: 2.1 time: 0.147331 May 17 22:19:02.393895 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 582/1185] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:02 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:03.410246 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-051ca4ae-c444-4552-8aa5-2c1793bf898b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:03.410811 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-051ca4ae-c444-4552-8aa5-2c1793bf898b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:03.417537 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-051ca4ae-c444-4552-8aa5-2c1793bf898b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:03.418534 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-051ca4ae-c444-4552-8aa5-2c1793bf898b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:03.418752 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-051ca4ae-c444-4552-8aa5-2c1793bf898b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:03.419193 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-051ca4ae-c444-4552-8aa5-2c1793bf898b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:03.546712 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-051ca4ae-c444-4552-8aa5-2c1793bf898b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:03.553985 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-051ca4ae-c444-4552-8aa5-2c1793bf898b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1267 microversion: 2.1 time: 0.147741 May 17 22:19:03.554533 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 604/1186] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:03 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:04.570786 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f8366614-8d31-424d-aad7-c02e24b8a18c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:04.571397 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f8366614-8d31-424d-aad7-c02e24b8a18c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:04.577870 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8366614-8d31-424d-aad7-c02e24b8a18c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:04.578316 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8366614-8d31-424d-aad7-c02e24b8a18c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:04.579076 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8366614-8d31-424d-aad7-c02e24b8a18c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:04.579533 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f8366614-8d31-424d-aad7-c02e24b8a18c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:04.806658 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-f8366614-8d31-424d-aad7-c02e24b8a18c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:04.814765 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f8366614-8d31-424d-aad7-c02e24b8a18c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1267 microversion: 2.1 time: 0.247983 May 17 22:19:04.815375 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 583/1187] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:04 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:05.153002 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-678bce87-9fa3-4215-974d-0a3e517f1537 req-5aa1287c-e862-4d92-976c-463a66a474db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b13b97f7-9d11-48f9-8cab-88dde91e34da", "name": "network-vif-plugged", "status": "completed", "tag": "aef37fd5-f4d9-4f6b-819b-ec2dd17475c3"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:19:05.161287 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-678bce87-9fa3-4215-974d-0a3e517f1537 req-5aa1287c-e862-4d92-976c-463a66a474db service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:05.161723 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-678bce87-9fa3-4215-974d-0a3e517f1537 req-5aa1287c-e862-4d92-976c-463a66a474db service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:05.173237 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-678bce87-9fa3-4215-974d-0a3e517f1537 req-5aa1287c-e862-4d92-976c-463a66a474db service nova] Creating event network-vif-plugged:aef37fd5-f4d9-4f6b-819b-ec2dd17475c3 for instance b13b97f7-9d11-48f9-8cab-88dde91e34da on hv-cinder-83998 May 17 22:19:05.178668 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-678bce87-9fa3-4215-974d-0a3e517f1537 req-5aa1287c-e862-4d92-976c-463a66a474db service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030437 May 17 22:19:05.179491 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 605/1188] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:19:05.830687 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1cd045c3-0828-4b08-81ea-43d12a9e314b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:05.831347 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1cd045c3-0828-4b08-81ea-43d12a9e314b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:05.837624 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1cd045c3-0828-4b08-81ea-43d12a9e314b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:05.838665 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1cd045c3-0828-4b08-81ea-43d12a9e314b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:05.839464 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1cd045c3-0828-4b08-81ea-43d12a9e314b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:05.839898 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1cd045c3-0828-4b08-81ea-43d12a9e314b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:05.971565 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1cd045c3-0828-4b08-81ea-43d12a9e314b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:05.979406 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1cd045c3-0828-4b08-81ea-43d12a9e314b tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1267 microversion: 2.1 time: 0.151924 May 17 22:19:05.980034 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 584/1189] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:05 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:06.996864 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-08395aa4-60e5-4afa-a536-30f094f63e92 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:06.997553 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-08395aa4-60e5-4afa-a536-30f094f63e92 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:07.004530 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-08395aa4-60e5-4afa-a536-30f094f63e92 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:07.004975 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-08395aa4-60e5-4afa-a536-30f094f63e92 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:07.006334 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-08395aa4-60e5-4afa-a536-30f094f63e92 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:07.006869 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-08395aa4-60e5-4afa-a536-30f094f63e92 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:07.189691 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-08395aa4-60e5-4afa-a536-30f094f63e92 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:07.196963 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-08395aa4-60e5-4afa-a536-30f094f63e92 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1267 microversion: 2.1 time: 0.205464 May 17 22:19:07.197557 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 606/1190] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:06 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:08.213784 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-03f29029-1220-4050-af63-40b323f3df41 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:08.214389 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-03f29029-1220-4050-af63-40b323f3df41 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:08.221055 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-03f29029-1220-4050-af63-40b323f3df41 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:08.221504 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-03f29029-1220-4050-af63-40b323f3df41 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:08.222264 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-03f29029-1220-4050-af63-40b323f3df41 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:08.222697 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-03f29029-1220-4050-af63-40b323f3df41 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:08.352703 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-03f29029-1220-4050-af63-40b323f3df41 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:08.360843 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-03f29029-1220-4050-af63-40b323f3df41 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1451 microversion: 2.1 time: 0.150945 May 17 22:19:08.361409 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 585/1191] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:08 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:08.376643 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-0440b69a-1fe8-4b38-a9b9-27fbe8184c49 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:08.377260 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-0440b69a-1fe8-4b38-a9b9-27fbe8184c49 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:08.383729 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0440b69a-1fe8-4b38-a9b9-27fbe8184c49 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:08.384179 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0440b69a-1fe8-4b38-a9b9-27fbe8184c49 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:08.384979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0440b69a-1fe8-4b38-a9b9-27fbe8184c49 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:08.385418 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-0440b69a-1fe8-4b38-a9b9-27fbe8184c49 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:08.510390 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-0440b69a-1fe8-4b38-a9b9-27fbe8184c49 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:08.518493 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-0440b69a-1fe8-4b38-a9b9-27fbe8184c49 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1451 microversion: 2.1 time: 0.145712 May 17 22:19:08.519057 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 607/1192] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:08 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:10.686699 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-efd83f37-a9b4-48f7-8554-7c5f769f1d4c req-76c909a5-118a-48b0-a942-125e9f1ccd9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b13b97f7-9d11-48f9-8cab-88dde91e34da", "tag": "aef37fd5-f4d9-4f6b-819b-ec2dd17475c3"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:19:10.695285 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-efd83f37-a9b4-48f7-8554-7c5f769f1d4c req-76c909a5-118a-48b0-a942-125e9f1ccd9f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:10.695726 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-efd83f37-a9b4-48f7-8554-7c5f769f1d4c req-76c909a5-118a-48b0-a942-125e9f1ccd9f service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:10.707549 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-efd83f37-a9b4-48f7-8554-7c5f769f1d4c req-76c909a5-118a-48b0-a942-125e9f1ccd9f service nova] Creating event network-changed:aef37fd5-f4d9-4f6b-819b-ec2dd17475c3 for instance b13b97f7-9d11-48f9-8cab-88dde91e34da on hv-cinder-83998 May 17 22:19:10.712930 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-efd83f37-a9b4-48f7-8554-7c5f769f1d4c req-76c909a5-118a-48b0-a942-125e9f1ccd9f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030878 May 17 22:19:10.713698 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 586/1193] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:19:22.657012 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c5d4f5ea-baa3-40ae-acaf-c97f384a1f5e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:22.658234 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c5d4f5ea-baa3-40ae-acaf-c97f384a1f5e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:22.660688 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-e5aa589c-f2c6-4acd-8670-f095907f688e req-9f870c26-8380-4198-9f42-4ae654d84842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11fe4fe4-16e9-4a9d-a0cf-954d520222c2", "tag": "9c8d665a-b5a0-45a4-a0ba-7f36817e2db3"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:19:22.664560 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c5d4f5ea-baa3-40ae-acaf-c97f384a1f5e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:22.665276 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c5d4f5ea-baa3-40ae-acaf-c97f384a1f5e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:22.665763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c5d4f5ea-baa3-40ae-acaf-c97f384a1f5e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:22.666462 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-c5d4f5ea-baa3-40ae-acaf-c97f384a1f5e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:22.669145 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-e5aa589c-f2c6-4acd-8670-f095907f688e req-9f870c26-8380-4198-9f42-4ae654d84842 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:22.670166 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-e5aa589c-f2c6-4acd-8670-f095907f688e req-9f870c26-8380-4198-9f42-4ae654d84842 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:22.681510 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-e5aa589c-f2c6-4acd-8670-f095907f688e req-9f870c26-8380-4198-9f42-4ae654d84842 service nova] Creating event network-changed:9c8d665a-b5a0-45a4-a0ba-7f36817e2db3 for instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 on hv-cinder-83998 May 17 22:19:22.686872 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-e5aa589c-f2c6-4acd-8670-f095907f688e req-9f870c26-8380-4198-9f42-4ae654d84842 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030759 May 17 22:19:22.688120 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 587/1194] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:19:22.693187 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c5d4f5ea-baa3-40ae-acaf-c97f384a1f5e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:19:23.042032 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c5d4f5ea-baa3-40ae-acaf-c97f384a1f5e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "DELETE /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 204 len: 0 microversion: 2.1 time: 0.389417 May 17 22:19:23.042906 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 608/1195] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:19:22 2022] DELETE /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:19:23.048626 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:19:23.048836 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Tue May 17 22:19:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:19:23.051695 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-ff27206a-4412-45a3-86ee-224ffd17a63e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:23.053170 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-ff27206a-4412-45a3-86ee-224ffd17a63e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:23.059398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ff27206a-4412-45a3-86ee-224ffd17a63e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:23.060522 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ff27206a-4412-45a3-86ee-224ffd17a63e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:23.065283 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ff27206a-4412-45a3-86ee-224ffd17a63e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:23.065283 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-ff27206a-4412-45a3-86ee-224ffd17a63e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:23.201609 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-ff27206a-4412-45a3-86ee-224ffd17a63e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:23.209485 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-ff27206a-4412-45a3-86ee-224ffd17a63e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.162028 May 17 22:19:23.210071 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 588/1196] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:23 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:24.227185 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2dce9aa1-947a-4d24-9135-4ac718daba0d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:24.227886 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2dce9aa1-947a-4d24-9135-4ac718daba0d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:24.235513 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2dce9aa1-947a-4d24-9135-4ac718daba0d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:24.235961 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2dce9aa1-947a-4d24-9135-4ac718daba0d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:24.236761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2dce9aa1-947a-4d24-9135-4ac718daba0d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:24.237195 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2dce9aa1-947a-4d24-9135-4ac718daba0d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:24.433461 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2dce9aa1-947a-4d24-9135-4ac718daba0d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:24.441681 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2dce9aa1-947a-4d24-9135-4ac718daba0d tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1567 microversion: 2.1 time: 0.218766 May 17 22:19:24.442247 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 609/1197] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:24 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:25.212763 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-e659f997-21a7-4138-aecf-9de5ea2c7375 req-32757a57-6d67-48df-9b58-a2ba29179702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11fe4fe4-16e9-4a9d-a0cf-954d520222c2", "name": "network-vif-deleted", "tag": "9c8d665a-b5a0-45a4-a0ba-7f36817e2db3"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:19:25.222597 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-e659f997-21a7-4138-aecf-9de5ea2c7375 req-32757a57-6d67-48df-9b58-a2ba29179702 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:25.223044 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-e659f997-21a7-4138-aecf-9de5ea2c7375 req-32757a57-6d67-48df-9b58-a2ba29179702 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:25.236262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-e659f997-21a7-4138-aecf-9de5ea2c7375 req-32757a57-6d67-48df-9b58-a2ba29179702 service nova] Creating event network-vif-deleted:9c8d665a-b5a0-45a4-a0ba-7f36817e2db3 for instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 on hv-cinder-83998 May 17 22:19:25.242032 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-e659f997-21a7-4138-aecf-9de5ea2c7375 req-32757a57-6d67-48df-9b58-a2ba29179702 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098266 May 17 22:19:25.242634 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 589/1198] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:19:25.460253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-3b095c3d-f16c-4a55-b09f-a12cecea190a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:25.461135 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-3b095c3d-f16c-4a55-b09f-a12cecea190a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:25.468505 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b095c3d-f16c-4a55-b09f-a12cecea190a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:25.468949 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b095c3d-f16c-4a55-b09f-a12cecea190a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:25.469729 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b095c3d-f16c-4a55-b09f-a12cecea190a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:25.470158 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-3b095c3d-f16c-4a55-b09f-a12cecea190a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:25.543728 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-3b095c3d-f16c-4a55-b09f-a12cecea190a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:25.551825 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-3b095c3d-f16c-4a55-b09f-a12cecea190a tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1218 microversion: 2.1 time: 0.096809 May 17 22:19:25.552414 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 610/1199] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:25 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:26.576111 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6dc181f2-7ddc-4c00-8363-29e102306663 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:26.576871 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6dc181f2-7ddc-4c00-8363-29e102306663 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:26.583777 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6dc181f2-7ddc-4c00-8363-29e102306663 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:26.584273 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6dc181f2-7ddc-4c00-8363-29e102306663 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:26.585042 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6dc181f2-7ddc-4c00-8363-29e102306663 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:26.585470 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6dc181f2-7ddc-4c00-8363-29e102306663 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:26.618148 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6dc181f2-7ddc-4c00-8363-29e102306663 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:26.618584 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6dc181f2-7ddc-4c00-8363-29e102306663 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:26.619063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-6dc181f2-7ddc-4c00-8363-29e102306663 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lazy-loading 'fault' on Instance uuid 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:19:26.660013 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6dc181f2-7ddc-4c00-8363-29e102306663 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '692710d8062c42b5a7fabf677bce0598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74eb5524f74d434b87ff129f9997176b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:19:26.667428 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6dc181f2-7ddc-4c00-8363-29e102306663 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 200 len: 1223 microversion: 2.1 time: 0.096318 May 17 22:19:26.667988 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 590/1200] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:26 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:19:27.686253 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-be0f8ff4-bea4-45fe-9f28-80fadd4bbc9e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:27.686852 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-be0f8ff4-bea4-45fe-9f28-80fadd4bbc9e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] [instance: 11fe4fe4-16e9-4a9d-a0cf-954d520222c2] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:19:27.693654 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be0f8ff4-bea4-45fe-9f28-80fadd4bbc9e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:27.694152 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be0f8ff4-bea4-45fe-9f28-80fadd4bbc9e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:27.694913 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be0f8ff4-bea4-45fe-9f28-80fadd4bbc9e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:19:27.695373 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-be0f8ff4-bea4-45fe-9f28-80fadd4bbc9e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:19:27.709076 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-be0f8ff4-bea4-45fe-9f28-80fadd4bbc9e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] HTTP exception thrown: Instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 could not be found. May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-be0f8ff4-bea4-45fe-9f28-80fadd4bbc9e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Request method failure captured: May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 HTTP/1.1 May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB5FwVSUFBULGRH8IVVAwkHxacyMJFYMISbT-fAPODYXEQX0ea_kILPuaIYawVgZDgCSBr4VLgNGpfjlyI9AklgM_JLGXMvPAAMgbCOuuy6V7U7VFzaYoQ-gJBKGoVoCDkXmxxZSsuMhN_2E3mhDFUPkA17osVF-fS2erpiXrn5y4w0 May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 74eb5524f74d434b87ff129f9997176b May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-TestShelveInstance-729309779 May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:19:27.710701 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:19:27.712292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/74eb5524f74d434b87ff129f9997176b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_74eb5524f74d434b87ff129f9997176b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/74eb5524f74d434b87ff129f9997176b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/74eb5524f74d434b87ff129f9997176b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:19:27.712292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-TestShelveInstance-729309779 May 17 22:19:27.712292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 74eb5524f74d434b87ff129f9997176b May 17 22:19:27.712292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-TestShelveInstance-729309779 May 17 22:19:27.712292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-TestShelveInstance-729309779-project May 17 22:19:27.712292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:19:27.712292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:19:27.712292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 692710d8062c42b5a7fabf677bce0598 May 17 22:19:27.712292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-TestShelveInstance-729309779-project May 17 22:19:27.712292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:19:27.712292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 could not be found. May 17 22:19:27.712292 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': '11fe4fe4-16e9-4a9d-a0cf-954d520222c2'} May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 could not be found. May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:19:27.713271 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 could not be found. May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 could not be found. May 17 22:19:27.714967 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:19:27.717081 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-be0f8ff4-bea4-45fe-9f28-80fadd4bbc9e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Returning 404 to user: Instance 11fe4fe4-16e9-4a9d-a0cf-954d520222c2 could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:19:27.717081 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-be0f8ff4-bea4-45fe-9f28-80fadd4bbc9e tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2" status: 404 len: 111 microversion: 2.1 time: 0.030615 May 17 22:19:27.717081 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 611/1201] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:19:27 2022] GET /compute/v2.1/servers/11fe4fe4-16e9-4a9d-a0cf-954d520222c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:19:27.961229 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-365e6b42-1d19-4d2b-8761-c60d73d98fb6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] Calling method '.version_select at 0x7f09f248ac10>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:19:28.042851 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-365e6b42-1d19-4d2b-8761-c60d73d98fb6 tempest-TestShelveInstance-729309779 tempest-TestShelveInstance-729309779-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-925432835" status: 202 len: 0 microversion: 2.1 time: 0.085685 May 17 22:19:28.043468 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 591/1202] 10.222.0.24 () {58 vars in 1250 bytes} [Tue May 17 22:19:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-925432835 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:21:05.834717 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b381f685-9490-4737-86d2-a077fca31bec] AMQP server on 10.222.0.24:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 17 22:21:05.838528 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-61a799d1-a2c9-4cdd-9347-afe930548b74 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:05.839022 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-61a799d1-a2c9-4cdd-9347-afe930548b74 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:05.845089 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61a799d1-a2c9-4cdd-9347-afe930548b74 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:05.845533 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61a799d1-a2c9-4cdd-9347-afe930548b74 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:05.846300 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61a799d1-a2c9-4cdd-9347-afe930548b74 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:05.846742 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-61a799d1-a2c9-4cdd-9347-afe930548b74 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:05.872305 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-61a799d1-a2c9-4cdd-9347-afe930548b74 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:21:06.114205 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-61a799d1-a2c9-4cdd-9347-afe930548b74 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 204 len: 0 microversion: 2.1 time: 0.281199 May 17 22:21:06.114897 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 612/1203] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:21:05 2022] DELETE /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:21:06.124467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a54a607a-7046-4224-8fbc-6d6876ef46af tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:06.125078 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a54a607a-7046-4224-8fbc-6d6876ef46af tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:06.130965 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a54a607a-7046-4224-8fbc-6d6876ef46af tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:06.131476 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a54a607a-7046-4224-8fbc-6d6876ef46af tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:06.132251 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a54a607a-7046-4224-8fbc-6d6876ef46af tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:06.132685 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a54a607a-7046-4224-8fbc-6d6876ef46af tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:06.263228 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a54a607a-7046-4224-8fbc-6d6876ef46af tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:06.270542 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a54a607a-7046-4224-8fbc-6d6876ef46af tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1576 microversion: 2.1 time: 0.151517 May 17 22:21:06.271122 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 592/1204] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:06 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:21:07.288957 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-74954852-5f1b-4cfc-9dbf-a64c54c6b468 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:07.289654 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-74954852-5f1b-4cfc-9dbf-a64c54c6b468 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:07.298111 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-74954852-5f1b-4cfc-9dbf-a64c54c6b468 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:07.298554 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-74954852-5f1b-4cfc-9dbf-a64c54c6b468 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:07.299346 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-74954852-5f1b-4cfc-9dbf-a64c54c6b468 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:07.299779 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-74954852-5f1b-4cfc-9dbf-a64c54c6b468 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:07.315496 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] [b381f685-9490-4737-86d2-a077fca31bec] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 50638. May 17 22:21:07.430626 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-74954852-5f1b-4cfc-9dbf-a64c54c6b468 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:07.438205 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-74954852-5f1b-4cfc-9dbf-a64c54c6b468 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1576 microversion: 2.1 time: 0.153481 May 17 22:21:07.438759 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 613/1205] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:07 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:08.457357 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-50d7bc5b-0678-46e2-bc5c-292e6fac0951 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:08.457987 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-50d7bc5b-0678-46e2-bc5c-292e6fac0951 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:08.465752 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50d7bc5b-0678-46e2-bc5c-292e6fac0951 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:08.466191 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50d7bc5b-0678-46e2-bc5c-292e6fac0951 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:08.466962 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50d7bc5b-0678-46e2-bc5c-292e6fac0951 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:08.467431 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-50d7bc5b-0678-46e2-bc5c-292e6fac0951 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:08.638455 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-50d7bc5b-0678-46e2-bc5c-292e6fac0951 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:08.645957 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-50d7bc5b-0678-46e2-bc5c-292e6fac0951 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1576 microversion: 2.1 time: 0.192526 May 17 22:21:08.646515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 593/1206] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:08 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:08.980592 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-87f87081-2521-42a7-915e-6e0b5a16d479 req-8497b9e7-d3dc-445f-a374-cdfaadb6f555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b13b97f7-9d11-48f9-8cab-88dde91e34da", "name": "network-vif-deleted", "tag": "aef37fd5-f4d9-4f6b-819b-ec2dd17475c3"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:21:08.988993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-87f87081-2521-42a7-915e-6e0b5a16d479 req-8497b9e7-d3dc-445f-a374-cdfaadb6f555 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:09.007677 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-87f87081-2521-42a7-915e-6e0b5a16d479 req-8497b9e7-d3dc-445f-a374-cdfaadb6f555 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:09.007677 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-87f87081-2521-42a7-915e-6e0b5a16d479 req-8497b9e7-d3dc-445f-a374-cdfaadb6f555 service nova] Creating event network-vif-deleted:aef37fd5-f4d9-4f6b-819b-ec2dd17475c3 for instance b13b97f7-9d11-48f9-8cab-88dde91e34da on hv-cinder-83998 May 17 22:21:09.007677 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-87f87081-2521-42a7-915e-6e0b5a16d479 req-8497b9e7-d3dc-445f-a374-cdfaadb6f555 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030668 May 17 22:21:09.007677 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 614/1207] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:21:09.664103 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6f73ae56-4b08-4691-b2fa-e9f37524f605 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:09.664671 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6f73ae56-4b08-4691-b2fa-e9f37524f605 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:09.670968 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f73ae56-4b08-4691-b2fa-e9f37524f605 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:09.671443 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f73ae56-4b08-4691-b2fa-e9f37524f605 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:09.672244 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f73ae56-4b08-4691-b2fa-e9f37524f605 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:09.672671 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f73ae56-4b08-4691-b2fa-e9f37524f605 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:09.706607 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f73ae56-4b08-4691-b2fa-e9f37524f605 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:09.707049 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f73ae56-4b08-4691-b2fa-e9f37524f605 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:09.707515 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.objects.instance [None req-6f73ae56-4b08-4691-b2fa-e9f37524f605 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lazy-loading 'fault' on Instance uuid b13b97f7-9d11-48f9-8cab-88dde91e34da {{(pid=117594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 22:21:09.753614 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6f73ae56-4b08-4691-b2fa-e9f37524f605 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:09.762606 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6f73ae56-4b08-4691-b2fa-e9f37524f605 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 200 len: 1231 microversion: 2.1 time: 0.102368 May 17 22:21:09.763186 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 594/1208] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:09 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:10.781109 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-53f6aca2-8972-47d6-8e27-c16d68bf3726 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:10.781742 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-53f6aca2-8972-47d6-8e27-c16d68bf3726 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:10.787847 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53f6aca2-8972-47d6-8e27-c16d68bf3726 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:10.788291 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53f6aca2-8972-47d6-8e27-c16d68bf3726 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:10.789042 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53f6aca2-8972-47d6-8e27-c16d68bf3726 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:10.789469 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-53f6aca2-8972-47d6-8e27-c16d68bf3726 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:10.802421 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-53f6aca2-8972-47d6-8e27-c16d68bf3726 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] HTTP exception thrown: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-53f6aca2-8972-47d6-8e27-c16d68bf3726 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Request method failure captured: May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da HTTP/1.1 May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB8u4y3DmLq2izRJob6xINO_NaDgOS6QgIrdjjdlUizjlvorKAa_ooFrRQy_KtOuojiCWeGJxVfvteTNadpHpyZ0Q_9SyOc_n1VAXfgLOaKzquEjIRwWUFU3ZqbP79UV_Qhmxg9TVf5oyiF2dRKIhh_b7Hj4eoHS92WWLiclFWkVPoE May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 3cf34ac8db96460ba3b25bfe4aa0680c May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-TestVolumeBootPattern-1640545390 May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:21:10.804026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:21:10.805771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3cf34ac8db96460ba3b25bfe4aa0680c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:21:10.805771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-TestVolumeBootPattern-1640545390 May 17 22:21:10.805771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 3cf34ac8db96460ba3b25bfe4aa0680c May 17 22:21:10.805771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1640545390 May 17 22:21:10.805771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-TestVolumeBootPattern-1640545390-project May 17 22:21:10.805771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:21:10.805771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:21:10.805771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 4c4de421a8224e89ab11a2a2d88f0315 May 17 22:21:10.805771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-TestVolumeBootPattern-1640545390-project May 17 22:21:10.805771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:21:10.805771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:21:10.805771 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': 'b13b97f7-9d11-48f9-8cab-88dde91e34da'} May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:21:10.808129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:21:10.809732 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:21:10.811174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-53f6aca2-8972-47d6-8e27-c16d68bf3726 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Returning 404 to user: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:21:10.811174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-53f6aca2-8972-47d6-8e27-c16d68bf3726 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 404 len: 111 microversion: 2.1 time: 0.029676 May 17 22:21:10.811174 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 615/1209] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:10 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:21:10.924928 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-331119958", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1523709044", "security_groups": [{"name": "tempest-secgroup-smoke-1817986569"}], "block_device_mapping_v2": [{"uuid": "f318eec5-92a2-4122-a704-25744fe83f23", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4473d761-85c9-4726-8a15-f941841bf909"}]}} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:21:11.034362 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.network.neutron [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] validate_networks() for [('4473d761-85c9-4726-8a15-f941841bf909', None, None, None, None, None)] {{(pid=117594) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:21:11.530877 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Flavor limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:21:11.531385 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Image limits 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:21:11.531856 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Flavor pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:21:11.532258 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Image pref 0:0:0 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:21:11.532663 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.virt.hardware [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:21:11.541697 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:11.542216 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:11.543041 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:11.543495 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:11.559767 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Getting quotas for project 3cf34ac8db96460ba3b25bfe4aa0680c. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:21:11.565070 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.quota [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Getting quotas for user 4c4de421a8224e89ab11a2a2d88f0315 and project 3cf34ac8db96460ba3b25bfe4aa0680c. Resources: {'cores', 'instances', 'ram'} {{(pid=117594) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:21:11.619881 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Going to run 1 instances... {{(pid=117594) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:21:11.621964 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f318eec5-92a2-4122-a704-25744fe83f23',volume_size=None,volume_type=None)] {{(pid=117594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:21:12.024817 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-670d5818-37ba-473f-93bb-82b2238bf018 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.103738 May 17 22:21:12.027828 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 595/1210] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:21:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:21:12.035672 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fc297554-ea09-43e8-851a-fd4a4058866f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:12.036338 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fc297554-ea09-43e8-851a-fd4a4058866f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:12.090946 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fc297554-ea09-43e8-851a-fd4a4058866f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:12.097358 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fc297554-ea09-43e8-851a-fd4a4058866f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1094 microversion: 2.1 time: 0.065540 May 17 22:21:12.097914 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 616/1211] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:12 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:13.115580 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-d0078e01-b690-422f-b81b-31059e1b4bd1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:13.116237 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-d0078e01-b690-422f-b81b-31059e1b4bd1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:13.122309 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d0078e01-b690-422f-b81b-31059e1b4bd1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:13.122764 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d0078e01-b690-422f-b81b-31059e1b4bd1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:13.123566 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d0078e01-b690-422f-b81b-31059e1b4bd1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:13.124004 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-d0078e01-b690-422f-b81b-31059e1b4bd1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:13.191634 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-d0078e01-b690-422f-b81b-31059e1b4bd1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:13.200396 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-d0078e01-b690-422f-b81b-31059e1b4bd1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1144 microversion: 2.1 time: 0.089205 May 17 22:21:13.200965 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 596/1212] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:13 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:14.217860 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-ad1fd5d7-de16-4823-845b-f28b203e55d0 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:14.218477 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-ad1fd5d7-de16-4823-845b-f28b203e55d0 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:14.225880 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad1fd5d7-de16-4823-845b-f28b203e55d0 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:14.226707 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad1fd5d7-de16-4823-845b-f28b203e55d0 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:14.227140 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad1fd5d7-de16-4823-845b-f28b203e55d0 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:14.227574 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-ad1fd5d7-de16-4823-845b-f28b203e55d0 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:14.316727 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-ad1fd5d7-de16-4823-845b-f28b203e55d0 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:14.324695 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-ad1fd5d7-de16-4823-845b-f28b203e55d0 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1200 microversion: 2.1 time: 0.110858 May 17 22:21:14.325258 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 617/1213] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:14 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1200 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:15.342274 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-edd03ffb-8faa-456e-8af4-56d0c13fe137 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:15.343036 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-edd03ffb-8faa-456e-8af4-56d0c13fe137 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:15.349714 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-edd03ffb-8faa-456e-8af4-56d0c13fe137 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:15.350158 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-edd03ffb-8faa-456e-8af4-56d0c13fe137 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:15.350925 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-edd03ffb-8faa-456e-8af4-56d0c13fe137 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:15.351380 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-edd03ffb-8faa-456e-8af4-56d0c13fe137 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:15.501554 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-edd03ffb-8faa-456e-8af4-56d0c13fe137 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:15.508941 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-edd03ffb-8faa-456e-8af4-56d0c13fe137 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1278 microversion: 2.1 time: 0.171233 May 17 22:21:15.509545 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 597/1214] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:15 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:15.862663 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-a65a427f-6c83-4003-aa82-03f72b6cbf6a req-2522642c-274b-4b28-9921-32cd96bf10c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78f8466-4ba9-4f79-b263-35f1f2634d82", "tag": "ab43ce5c-af1b-4d01-ba97-a20314eed9f7"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:21:15.871744 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-a65a427f-6c83-4003-aa82-03f72b6cbf6a req-2522642c-274b-4b28-9921-32cd96bf10c6 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:15.872277 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-a65a427f-6c83-4003-aa82-03f72b6cbf6a req-2522642c-274b-4b28-9921-32cd96bf10c6 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:15.887236 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-a65a427f-6c83-4003-aa82-03f72b6cbf6a req-2522642c-274b-4b28-9921-32cd96bf10c6 service nova] Creating event network-changed:ab43ce5c-af1b-4d01-ba97-a20314eed9f7 for instance c78f8466-4ba9-4f79-b263-35f1f2634d82 on hv-cinder-83998 May 17 22:21:15.896323 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-a65a427f-6c83-4003-aa82-03f72b6cbf6a req-2522642c-274b-4b28-9921-32cd96bf10c6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037362 May 17 22:21:15.896913 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 618/1215] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:21:16.526095 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-11d7ecf0-cead-48d3-b58f-84723df914f9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:16.526728 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-11d7ecf0-cead-48d3-b58f-84723df914f9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:16.533031 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-11d7ecf0-cead-48d3-b58f-84723df914f9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:16.533484 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-11d7ecf0-cead-48d3-b58f-84723df914f9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:16.534255 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-11d7ecf0-cead-48d3-b58f-84723df914f9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:16.534692 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-11d7ecf0-cead-48d3-b58f-84723df914f9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:16.665029 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-11d7ecf0-cead-48d3-b58f-84723df914f9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:16.673219 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-11d7ecf0-cead-48d3-b58f-84723df914f9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1266 microversion: 2.1 time: 0.151137 May 17 22:21:16.673775 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 598/1216] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:16 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:17.692337 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8c61650c-e0c9-45cf-b671-459ad080035e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:17.693031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8c61650c-e0c9-45cf-b671-459ad080035e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:17.700137 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8c61650c-e0c9-45cf-b671-459ad080035e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:17.700579 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8c61650c-e0c9-45cf-b671-459ad080035e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:17.701343 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8c61650c-e0c9-45cf-b671-459ad080035e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:17.701772 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8c61650c-e0c9-45cf-b671-459ad080035e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:17.828774 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-8c61650c-e0c9-45cf-b671-459ad080035e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:17.836057 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8c61650c-e0c9-45cf-b671-459ad080035e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1266 microversion: 2.1 time: 0.148948 May 17 22:21:17.836613 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 619/1217] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:17 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:18.852878 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-a5157884-1cdd-4286-a68e-e33b68fa5cd6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:18.853555 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-a5157884-1cdd-4286-a68e-e33b68fa5cd6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:18.859883 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5157884-1cdd-4286-a68e-e33b68fa5cd6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:18.860334 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5157884-1cdd-4286-a68e-e33b68fa5cd6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:18.861089 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5157884-1cdd-4286-a68e-e33b68fa5cd6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:18.861527 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-a5157884-1cdd-4286-a68e-e33b68fa5cd6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:18.995529 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-a5157884-1cdd-4286-a68e-e33b68fa5cd6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:19.002761 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-a5157884-1cdd-4286-a68e-e33b68fa5cd6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1266 microversion: 2.1 time: 0.153854 May 17 22:21:19.003347 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 599/1218] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:18 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:20.019993 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-f14854dc-133b-4400-a8d1-b03da026e4c6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:20.020598 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-f14854dc-133b-4400-a8d1-b03da026e4c6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:20.027126 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f14854dc-133b-4400-a8d1-b03da026e4c6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:20.027585 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f14854dc-133b-4400-a8d1-b03da026e4c6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:20.028353 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f14854dc-133b-4400-a8d1-b03da026e4c6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:20.028789 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-f14854dc-133b-4400-a8d1-b03da026e4c6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:20.155604 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-f14854dc-133b-4400-a8d1-b03da026e4c6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:20.162784 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-f14854dc-133b-4400-a8d1-b03da026e4c6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1266 microversion: 2.1 time: 0.146645 May 17 22:21:20.163372 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 620/1219] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:20 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:21.179816 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-1be443df-5dbc-42e3-ac89-bf38f0f0da5e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:21.180382 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-1be443df-5dbc-42e3-ac89-bf38f0f0da5e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:21.187418 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1be443df-5dbc-42e3-ac89-bf38f0f0da5e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:21.187866 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1be443df-5dbc-42e3-ac89-bf38f0f0da5e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:21.188628 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1be443df-5dbc-42e3-ac89-bf38f0f0da5e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:21.189063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-1be443df-5dbc-42e3-ac89-bf38f0f0da5e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:21.320504 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-1be443df-5dbc-42e3-ac89-bf38f0f0da5e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:21.327809 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-1be443df-5dbc-42e3-ac89-bf38f0f0da5e tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1266 microversion: 2.1 time: 0.151919 May 17 22:21:21.328352 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 600/1220] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:21 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:22.344506 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a8000cb4-5f05-4fad-9781-3e2900198c3a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:22.345078 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a8000cb4-5f05-4fad-9781-3e2900198c3a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:22.351351 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a8000cb4-5f05-4fad-9781-3e2900198c3a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:22.351791 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a8000cb4-5f05-4fad-9781-3e2900198c3a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:22.352541 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a8000cb4-5f05-4fad-9781-3e2900198c3a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:22.353019 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a8000cb4-5f05-4fad-9781-3e2900198c3a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:22.480857 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a8000cb4-5f05-4fad-9781-3e2900198c3a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:22.488115 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a8000cb4-5f05-4fad-9781-3e2900198c3a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1266 microversion: 2.1 time: 0.147537 May 17 22:21:22.488670 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 621/1221] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:22 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:23.505010 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b82889cc-b301-4b71-9523-cc84e4703829 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:23.505643 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b82889cc-b301-4b71-9523-cc84e4703829 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:23.512499 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b82889cc-b301-4b71-9523-cc84e4703829 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:23.512977 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b82889cc-b301-4b71-9523-cc84e4703829 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:23.513742 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b82889cc-b301-4b71-9523-cc84e4703829 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:23.514177 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b82889cc-b301-4b71-9523-cc84e4703829 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:23.643827 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b82889cc-b301-4b71-9523-cc84e4703829 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:23.651842 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b82889cc-b301-4b71-9523-cc84e4703829 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1266 microversion: 2.1 time: 0.150697 May 17 22:21:23.652407 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 601/1222] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:23 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:24.668381 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-d7a110c8-80b2-47ae-b242-02ceb9f23967 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:24.668989 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-d7a110c8-80b2-47ae-b242-02ceb9f23967 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:24.676084 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d7a110c8-80b2-47ae-b242-02ceb9f23967 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:24.676528 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d7a110c8-80b2-47ae-b242-02ceb9f23967 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:24.677285 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d7a110c8-80b2-47ae-b242-02ceb9f23967 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:24.677711 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-d7a110c8-80b2-47ae-b242-02ceb9f23967 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:24.804208 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-d7a110c8-80b2-47ae-b242-02ceb9f23967 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:24.811511 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-d7a110c8-80b2-47ae-b242-02ceb9f23967 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1266 microversion: 2.1 time: 0.147143 May 17 22:21:24.812073 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 622/1223] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:24 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:25.828738 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b6e9f170-3675-41d4-ae6c-b0732f53f4c1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:25.829348 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b6e9f170-3675-41d4-ae6c-b0732f53f4c1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:25.835763 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b6e9f170-3675-41d4-ae6c-b0732f53f4c1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:25.836215 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b6e9f170-3675-41d4-ae6c-b0732f53f4c1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:25.836984 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b6e9f170-3675-41d4-ae6c-b0732f53f4c1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:25.838098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b6e9f170-3675-41d4-ae6c-b0732f53f4c1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:25.969533 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-b6e9f170-3675-41d4-ae6c-b0732f53f4c1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:25.976917 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b6e9f170-3675-41d4-ae6c-b0732f53f4c1 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1266 microversion: 2.1 time: 0.152006 May 17 22:21:25.977431 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 602/1224] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:25 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:21:26.994000 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-9acbe929-fc7e-4b45-b33d-3a2d91f7dc0c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:26.994610 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-9acbe929-fc7e-4b45-b33d-3a2d91f7dc0c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:27.000986 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9acbe929-fc7e-4b45-b33d-3a2d91f7dc0c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:27.001440 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9acbe929-fc7e-4b45-b33d-3a2d91f7dc0c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:27.002210 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9acbe929-fc7e-4b45-b33d-3a2d91f7dc0c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:27.002645 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-9acbe929-fc7e-4b45-b33d-3a2d91f7dc0c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:27.131260 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-9acbe929-fc7e-4b45-b33d-3a2d91f7dc0c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:27.139910 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-9acbe929-fc7e-4b45-b33d-3a2d91f7dc0c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1266 microversion: 2.1 time: 0.149872 May 17 22:21:27.141596 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 623/1225] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:26 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:27.789526 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-9081a19b-afb1-4c5e-adf4-ef0769c56f4f req-e9af3688-f2a1-4431-b9b1-70047ad01bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78f8466-4ba9-4f79-b263-35f1f2634d82", "name": "network-vif-plugged", "status": "completed", "tag": "ab43ce5c-af1b-4d01-ba97-a20314eed9f7"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:21:27.800072 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-9081a19b-afb1-4c5e-adf4-ef0769c56f4f req-e9af3688-f2a1-4431-b9b1-70047ad01bc3 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:27.800502 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-9081a19b-afb1-4c5e-adf4-ef0769c56f4f req-e9af3688-f2a1-4431-b9b1-70047ad01bc3 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:27.815895 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-9081a19b-afb1-4c5e-adf4-ef0769c56f4f req-e9af3688-f2a1-4431-b9b1-70047ad01bc3 service nova] Creating event network-vif-plugged:ab43ce5c-af1b-4d01-ba97-a20314eed9f7 for instance c78f8466-4ba9-4f79-b263-35f1f2634d82 on hv-cinder-83998 May 17 22:21:27.821370 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-9081a19b-afb1-4c5e-adf4-ef0769c56f4f req-e9af3688-f2a1-4431-b9b1-70047ad01bc3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175900 May 17 22:21:27.827001 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 603/1226] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:21:28.160850 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-15c9de16-5b0b-453c-8853-e6402067705c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:28.161466 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-15c9de16-5b0b-453c-8853-e6402067705c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:28.167966 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15c9de16-5b0b-453c-8853-e6402067705c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:28.168424 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15c9de16-5b0b-453c-8853-e6402067705c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:28.169210 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15c9de16-5b0b-453c-8853-e6402067705c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:28.169648 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15c9de16-5b0b-453c-8853-e6402067705c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:28.301871 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-15c9de16-5b0b-453c-8853-e6402067705c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:28.309971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-15c9de16-5b0b-453c-8853-e6402067705c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1266 microversion: 2.1 time: 0.153101 May 17 22:21:28.310542 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 624/1227] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:28 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:29.329021 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6efba6d9-fb83-49ae-855b-6183aa57c1ad tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:29.329714 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6efba6d9-fb83-49ae-855b-6183aa57c1ad tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:29.335813 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6efba6d9-fb83-49ae-855b-6183aa57c1ad tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:29.336258 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6efba6d9-fb83-49ae-855b-6183aa57c1ad tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:29.337191 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6efba6d9-fb83-49ae-855b-6183aa57c1ad tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:29.338185 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6efba6d9-fb83-49ae-855b-6183aa57c1ad tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:29.481150 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6efba6d9-fb83-49ae-855b-6183aa57c1ad tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:29.488654 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6efba6d9-fb83-49ae-855b-6183aa57c1ad tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1450 microversion: 2.1 time: 0.164222 May 17 22:21:29.489225 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 604/1228] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:29 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:21:29.510683 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-480edf9f-f1ae-4d35-93af-d6cb659ddc4d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:21:29.511354 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-480edf9f-f1ae-4d35-93af-d6cb659ddc4d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:21:29.517672 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-480edf9f-f1ae-4d35-93af-d6cb659ddc4d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:29.518113 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-480edf9f-f1ae-4d35-93af-d6cb659ddc4d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:29.518870 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-480edf9f-f1ae-4d35-93af-d6cb659ddc4d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:29.519329 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-480edf9f-f1ae-4d35-93af-d6cb659ddc4d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:29.645642 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-480edf9f-f1ae-4d35-93af-d6cb659ddc4d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:21:29.653724 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-480edf9f-f1ae-4d35-93af-d6cb659ddc4d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1450 microversion: 2.1 time: 0.147738 May 17 22:21:29.654274 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 625/1229] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:21:29 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:21:31.774205 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-31874e13-8435-4956-b192-f6157f42f314 req-3e676ab1-3f6f-4e35-a963-0a985bed0407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78f8466-4ba9-4f79-b263-35f1f2634d82", "tag": "ab43ce5c-af1b-4d01-ba97-a20314eed9f7"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:21:31.783376 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-31874e13-8435-4956-b192-f6157f42f314 req-3e676ab1-3f6f-4e35-a963-0a985bed0407 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:21:31.783817 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-31874e13-8435-4956-b192-f6157f42f314 req-3e676ab1-3f6f-4e35-a963-0a985bed0407 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:21:31.795789 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-31874e13-8435-4956-b192-f6157f42f314 req-3e676ab1-3f6f-4e35-a963-0a985bed0407 service nova] Creating event network-changed:ab43ce5c-af1b-4d01-ba97-a20314eed9f7 for instance c78f8466-4ba9-4f79-b263-35f1f2634d82 on hv-cinder-83998 May 17 22:21:31.801197 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-31874e13-8435-4956-b192-f6157f42f314 req-3e676ab1-3f6f-4e35-a963-0a985bed0407 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030789 May 17 22:21:31.802268 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 605/1230] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:22:28.709277 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:22:28.709901 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Tue May 17 22:22:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:22:43.057259 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:22:43.057827 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Tue May 17 22:22:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:23:17.728553 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-5310837", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1523709044", "security_groups": [{"name": "tempest-secgroup-smoke-1817986569"}], "block_device_mapping_v2": [{"uuid": "d1f66ff5-833d-4973-8728-9af0e61e0d43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4473d761-85c9-4726-8a15-f941841bf909"}]}} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:23:17.836492 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.network.neutron [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] validate_networks() for [('4473d761-85c9-4726-8a15-f941841bf909', None, None, None, None, None)] {{(pid=117593) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 22:23:18.250943 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Flavor limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 22:23:18.252031 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Image limits 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 22:23:18.252526 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Flavor pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 22:23:18.252970 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Image pref 0:0:0 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 22:23:18.253383 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.virt.hardware [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 22:23:18.261941 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:18.263010 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:18.263199 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:18.263634 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:18.280410 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Getting quotas for project 3cf34ac8db96460ba3b25bfe4aa0680c. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 22:23:18.284978 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.quota [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Getting quotas for user 4c4de421a8224e89ab11a2a2d88f0315 and project 3cf34ac8db96460ba3b25bfe4aa0680c. Resources: {'cores', 'instances', 'ram'} {{(pid=117593) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 22:23:18.339580 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Going to run 1 instances... {{(pid=117593) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 22:23:18.341633 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1f66ff5-833d-4973-8728-9af0e61e0d43',volume_size=None,volume_type=None)] {{(pid=117593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 22:23:18.698268 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-8b8812a5-a243-40f0-a561-8557822ead57 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.974559 May 17 22:23:18.698899 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 626/1231] 10.222.0.24 () {60 vars in 1146 bytes} [Tue May 17 22:23:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 22:23:18.711125 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-474c8ecb-74f8-4f16-b977-3a9710055821 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:18.717938 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-474c8ecb-74f8-4f16-b977-3a9710055821 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:18.766151 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-474c8ecb-74f8-4f16-b977-3a9710055821 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:18.773825 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-474c8ecb-74f8-4f16-b977-3a9710055821 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1092 microversion: 2.1 time: 0.067977 May 17 22:23:18.774300 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 606/1232] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:18 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1092 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:19.790554 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c213af70-76fc-4804-95dc-2c9f5966e681 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:19.791288 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c213af70-76fc-4804-95dc-2c9f5966e681 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:19.844276 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c213af70-76fc-4804-95dc-2c9f5966e681 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:19.850725 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c213af70-76fc-4804-95dc-2c9f5966e681 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1092 microversion: 2.1 time: 0.064864 May 17 22:23:19.851319 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 627/1233] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:19 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1092 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:20.867359 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-dba19545-1a1a-49db-aca1-522b3585e2af tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:20.867966 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-dba19545-1a1a-49db-aca1-522b3585e2af tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:20.920707 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-dba19545-1a1a-49db-aca1-522b3585e2af tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:20.927661 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-dba19545-1a1a-49db-aca1-522b3585e2af tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1092 microversion: 2.1 time: 0.064220 May 17 22:23:20.928215 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 607/1234] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:20 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1092 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:21.944620 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-c3a0c289-acff-4501-bba5-e8dc591595f9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:21.945261 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-c3a0c289-acff-4501-bba5-e8dc591595f9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:22.000163 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-c3a0c289-acff-4501-bba5-e8dc591595f9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:22.007265 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-c3a0c289-acff-4501-bba5-e8dc591595f9 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1092 microversion: 2.1 time: 0.066784 May 17 22:23:22.007817 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 628/1235] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:21 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1092 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:23.023737 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9b013ed1-fd61-4d2f-aca5-562206025789 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:23.024358 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9b013ed1-fd61-4d2f-aca5-562206025789 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:23.031166 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b013ed1-fd61-4d2f-aca5-562206025789 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:23.031613 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b013ed1-fd61-4d2f-aca5-562206025789 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:23.032856 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b013ed1-fd61-4d2f-aca5-562206025789 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:23.033294 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9b013ed1-fd61-4d2f-aca5-562206025789 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:23.091760 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9b013ed1-fd61-4d2f-aca5-562206025789 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:23.099489 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9b013ed1-fd61-4d2f-aca5-562206025789 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1142 microversion: 2.1 time: 0.079565 May 17 22:23:23.100046 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 608/1236] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:23 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1142 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:24.116272 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-1c086e00-9a97-4cc9-b885-ebcc236e7c61 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:24.116909 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-1c086e00-9a97-4cc9-b885-ebcc236e7c61 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:24.123761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1c086e00-9a97-4cc9-b885-ebcc236e7c61 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:24.124213 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1c086e00-9a97-4cc9-b885-ebcc236e7c61 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:24.124977 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1c086e00-9a97-4cc9-b885-ebcc236e7c61 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:24.125409 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-1c086e00-9a97-4cc9-b885-ebcc236e7c61 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:24.187634 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-1c086e00-9a97-4cc9-b885-ebcc236e7c61 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:24.196028 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-1c086e00-9a97-4cc9-b885-ebcc236e7c61 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1190 microversion: 2.1 time: 0.083575 May 17 22:23:24.196592 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 629/1237] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:24 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1190 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:25.213038 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-12942cd4-a502-4f98-9727-f18d72da2f58 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:25.214182 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-12942cd4-a502-4f98-9727-f18d72da2f58 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:25.221580 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-12942cd4-a502-4f98-9727-f18d72da2f58 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:25.222029 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-12942cd4-a502-4f98-9727-f18d72da2f58 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:25.222817 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-12942cd4-a502-4f98-9727-f18d72da2f58 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:25.223291 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-12942cd4-a502-4f98-9727-f18d72da2f58 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:25.421435 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-12942cd4-a502-4f98-9727-f18d72da2f58 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:25.428921 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-12942cd4-a502-4f98-9727-f18d72da2f58 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1276 microversion: 2.1 time: 0.219794 May 17 22:23:25.437130 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 609/1238] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:25 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:26.152860 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-d166c55d-f51b-43b3-b70b-8959f3ce490b req-abc0114e-9224-4926-9f97-9193d269dc04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "887a838d-b609-47bd-bf1c-780b3010e4cd", "tag": "a0660c66-a9fc-491e-ad45-b6d840554e29"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:23:26.162576 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-d166c55d-f51b-43b3-b70b-8959f3ce490b req-abc0114e-9224-4926-9f97-9193d269dc04 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:26.163017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-d166c55d-f51b-43b3-b70b-8959f3ce490b req-abc0114e-9224-4926-9f97-9193d269dc04 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:26.176739 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-d166c55d-f51b-43b3-b70b-8959f3ce490b req-abc0114e-9224-4926-9f97-9193d269dc04 service nova] Creating event network-changed:a0660c66-a9fc-491e-ad45-b6d840554e29 for instance 887a838d-b609-47bd-bf1c-780b3010e4cd on hv-cinder-83998 May 17 22:23:26.182069 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-d166c55d-f51b-43b3-b70b-8959f3ce490b req-abc0114e-9224-4926-9f97-9193d269dc04 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033177 May 17 22:23:26.183040 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 630/1239] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:23:26.446276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6d7df48d-efa5-4839-8323-d2b98a86b0c7 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:26.446926 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6d7df48d-efa5-4839-8323-d2b98a86b0c7 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:26.452989 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d7df48d-efa5-4839-8323-d2b98a86b0c7 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:26.453431 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d7df48d-efa5-4839-8323-d2b98a86b0c7 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:26.454201 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d7df48d-efa5-4839-8323-d2b98a86b0c7 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:26.454637 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6d7df48d-efa5-4839-8323-d2b98a86b0c7 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:26.668945 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6d7df48d-efa5-4839-8323-d2b98a86b0c7 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:26.677329 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6d7df48d-efa5-4839-8323-d2b98a86b0c7 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1264 microversion: 2.1 time: 0.234955 May 17 22:23:26.677925 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 610/1240] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:26 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:27.696813 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fdd9bda4-7252-4c04-b234-3df9151ecfe5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:27.697503 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fdd9bda4-7252-4c04-b234-3df9151ecfe5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:27.703954 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fdd9bda4-7252-4c04-b234-3df9151ecfe5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:27.705344 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fdd9bda4-7252-4c04-b234-3df9151ecfe5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:27.705891 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fdd9bda4-7252-4c04-b234-3df9151ecfe5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:27.706320 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fdd9bda4-7252-4c04-b234-3df9151ecfe5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:27.837039 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fdd9bda4-7252-4c04-b234-3df9151ecfe5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:27.844284 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fdd9bda4-7252-4c04-b234-3df9151ecfe5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1264 microversion: 2.1 time: 0.151692 May 17 22:23:27.844900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 631/1241] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:27 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:28.860145 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5dfb556b-f809-48e3-ab16-f06f83b487be tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:28.861296 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5dfb556b-f809-48e3-ab16-f06f83b487be tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:28.867637 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5dfb556b-f809-48e3-ab16-f06f83b487be tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:28.868083 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5dfb556b-f809-48e3-ab16-f06f83b487be tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:28.868845 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5dfb556b-f809-48e3-ab16-f06f83b487be tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:28.869278 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5dfb556b-f809-48e3-ab16-f06f83b487be tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:29.044682 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5dfb556b-f809-48e3-ab16-f06f83b487be tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:29.052940 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5dfb556b-f809-48e3-ab16-f06f83b487be tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1264 microversion: 2.1 time: 0.196599 May 17 22:23:29.053550 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 611/1242] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:28 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:30.069658 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-641613b7-3e72-4ffc-921a-0c2c5f08a01f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:30.070295 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-641613b7-3e72-4ffc-921a-0c2c5f08a01f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:30.076664 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-641613b7-3e72-4ffc-921a-0c2c5f08a01f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:30.081805 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-641613b7-3e72-4ffc-921a-0c2c5f08a01f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:30.083041 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-641613b7-3e72-4ffc-921a-0c2c5f08a01f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:30.083510 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-641613b7-3e72-4ffc-921a-0c2c5f08a01f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:30.216161 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-641613b7-3e72-4ffc-921a-0c2c5f08a01f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:30.223442 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-641613b7-3e72-4ffc-921a-0c2c5f08a01f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1264 microversion: 2.1 time: 0.157952 May 17 22:23:30.224005 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 632/1243] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:30 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:31.240623 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-113e91a9-1769-48f1-b797-adb63fe568d5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:31.241192 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-113e91a9-1769-48f1-b797-adb63fe568d5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:31.247512 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-113e91a9-1769-48f1-b797-adb63fe568d5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:31.247963 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-113e91a9-1769-48f1-b797-adb63fe568d5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:31.248732 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-113e91a9-1769-48f1-b797-adb63fe568d5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:31.249171 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-113e91a9-1769-48f1-b797-adb63fe568d5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:31.379347 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-113e91a9-1769-48f1-b797-adb63fe568d5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:31.386666 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-113e91a9-1769-48f1-b797-adb63fe568d5 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1264 microversion: 2.1 time: 0.149994 May 17 22:23:31.387246 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 612/1244] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:31 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:32.403514 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-7c3047f9-cfc2-446c-af3c-1d402b4fe9ef tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:32.404116 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-7c3047f9-cfc2-446c-af3c-1d402b4fe9ef tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:32.410657 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c3047f9-cfc2-446c-af3c-1d402b4fe9ef tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:32.411099 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c3047f9-cfc2-446c-af3c-1d402b4fe9ef tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:32.411893 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c3047f9-cfc2-446c-af3c-1d402b4fe9ef tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:32.412349 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-7c3047f9-cfc2-446c-af3c-1d402b4fe9ef tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:32.543956 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-7c3047f9-cfc2-446c-af3c-1d402b4fe9ef tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:32.551608 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-7c3047f9-cfc2-446c-af3c-1d402b4fe9ef tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1264 microversion: 2.1 time: 0.152013 May 17 22:23:32.552158 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 633/1245] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:32 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:33.568562 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-5f4d7bb1-8650-4c9c-bdce-7b69dd44c7b2 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:33.569170 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-5f4d7bb1-8650-4c9c-bdce-7b69dd44c7b2 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:33.575496 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f4d7bb1-8650-4c9c-bdce-7b69dd44c7b2 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:33.575947 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f4d7bb1-8650-4c9c-bdce-7b69dd44c7b2 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:33.576706 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f4d7bb1-8650-4c9c-bdce-7b69dd44c7b2 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:33.577147 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-5f4d7bb1-8650-4c9c-bdce-7b69dd44c7b2 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:33.702925 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-5f4d7bb1-8650-4c9c-bdce-7b69dd44c7b2 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:33.710283 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-5f4d7bb1-8650-4c9c-bdce-7b69dd44c7b2 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1264 microversion: 2.1 time: 0.145828 May 17 22:23:33.710847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 613/1246] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:33 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:34.727956 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-2b8b7578-3be1-453f-aa9c-eb7ff9199d0a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:34.728562 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-2b8b7578-3be1-453f-aa9c-eb7ff9199d0a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:34.734862 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b8b7578-3be1-453f-aa9c-eb7ff9199d0a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:34.736214 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b8b7578-3be1-453f-aa9c-eb7ff9199d0a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:34.736965 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b8b7578-3be1-453f-aa9c-eb7ff9199d0a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:34.737404 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-2b8b7578-3be1-453f-aa9c-eb7ff9199d0a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:34.863881 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-2b8b7578-3be1-453f-aa9c-eb7ff9199d0a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:34.871017 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-2b8b7578-3be1-453f-aa9c-eb7ff9199d0a tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1264 microversion: 2.1 time: 0.146968 May 17 22:23:34.871596 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 634/1247] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:34 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:35.887246 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9042dab2-29ec-4113-a321-540815eee765 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:35.887838 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9042dab2-29ec-4113-a321-540815eee765 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:35.895066 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9042dab2-29ec-4113-a321-540815eee765 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:35.895546 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9042dab2-29ec-4113-a321-540815eee765 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:35.896320 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9042dab2-29ec-4113-a321-540815eee765 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:35.896749 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9042dab2-29ec-4113-a321-540815eee765 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:36.028560 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9042dab2-29ec-4113-a321-540815eee765 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:36.036174 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9042dab2-29ec-4113-a321-540815eee765 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1264 microversion: 2.1 time: 0.152827 May 17 22:23:36.036739 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 614/1248] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:35 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:37.054757 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-6b6cfdd8-62fc-4a9a-a44a-492b8b3372cb tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:37.055394 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-6b6cfdd8-62fc-4a9a-a44a-492b8b3372cb tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:37.061687 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6b6cfdd8-62fc-4a9a-a44a-492b8b3372cb tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:37.062137 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6b6cfdd8-62fc-4a9a-a44a-492b8b3372cb tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:37.062898 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6b6cfdd8-62fc-4a9a-a44a-492b8b3372cb tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:37.064233 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-6b6cfdd8-62fc-4a9a-a44a-492b8b3372cb tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:37.191763 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-6b6cfdd8-62fc-4a9a-a44a-492b8b3372cb tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:37.198958 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-6b6cfdd8-62fc-4a9a-a44a-492b8b3372cb tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1264 microversion: 2.1 time: 0.148118 May 17 22:23:37.199539 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 635/1249] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:37 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:38.216035 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-9e08bafb-d277-4a1c-896f-51aa3999c1b8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:38.216673 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-9e08bafb-d277-4a1c-896f-51aa3999c1b8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:38.223462 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9e08bafb-d277-4a1c-896f-51aa3999c1b8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:38.223918 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9e08bafb-d277-4a1c-896f-51aa3999c1b8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:38.224695 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9e08bafb-d277-4a1c-896f-51aa3999c1b8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:38.225133 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-9e08bafb-d277-4a1c-896f-51aa3999c1b8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:38.277721 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [req-8a735e2e-a360-4851-9d11-24865709591f req-59bfeb95-886f-43b1-8213-493a6a66e95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "887a838d-b609-47bd-bf1c-780b3010e4cd", "name": "network-vif-plugged", "status": "completed", "tag": "a0660c66-a9fc-491e-ad45-b6d840554e29"}]} {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:23:38.286060 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-8a735e2e-a360-4851-9d11-24865709591f req-59bfeb95-886f-43b1-8213-493a6a66e95e service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:38.286517 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [req-8a735e2e-a360-4851-9d11-24865709591f req-59bfeb95-886f-43b1-8213-493a6a66e95e service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:38.298714 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.compute.server_external_events [req-8a735e2e-a360-4851-9d11-24865709591f req-59bfeb95-886f-43b1-8213-493a6a66e95e service nova] Creating event network-vif-plugged:a0660c66-a9fc-491e-ad45-b6d840554e29 for instance 887a838d-b609-47bd-bf1c-780b3010e4cd on hv-cinder-83998 May 17 22:23:38.304026 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [req-8a735e2e-a360-4851-9d11-24865709591f req-59bfeb95-886f-43b1-8213-493a6a66e95e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029682 May 17 22:23:38.304856 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 636/1250] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 22:23:38.367156 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-9e08bafb-d277-4a1c-896f-51aa3999c1b8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:38.374959 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-9e08bafb-d277-4a1c-896f-51aa3999c1b8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1264 microversion: 2.1 time: 0.162913 May 17 22:23:38.376330 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 615/1251] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:38 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:39.393541 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-fde61e2d-ad1a-4f4a-bb87-4ee820131810 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:39.394229 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-fde61e2d-ad1a-4f4a-bb87-4ee820131810 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:39.400365 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fde61e2d-ad1a-4f4a-bb87-4ee820131810 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:39.400815 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fde61e2d-ad1a-4f4a-bb87-4ee820131810 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:39.401575 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fde61e2d-ad1a-4f4a-bb87-4ee820131810 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:39.402013 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-fde61e2d-ad1a-4f4a-bb87-4ee820131810 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:39.529322 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-fde61e2d-ad1a-4f4a-bb87-4ee820131810 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:39.537198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-fde61e2d-ad1a-4f4a-bb87-4ee820131810 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1264 microversion: 2.1 time: 0.148436 May 17 22:23:39.537761 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 637/1252] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:39 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:40.554365 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-6f415bdc-42bc-47a6-bfee-88f2fdc4077c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:40.554966 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-6f415bdc-42bc-47a6-bfee-88f2fdc4077c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:40.561380 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f415bdc-42bc-47a6-bfee-88f2fdc4077c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:40.561828 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f415bdc-42bc-47a6-bfee-88f2fdc4077c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:40.562591 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f415bdc-42bc-47a6-bfee-88f2fdc4077c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:40.563020 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-6f415bdc-42bc-47a6-bfee-88f2fdc4077c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:40.691779 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-6f415bdc-42bc-47a6-bfee-88f2fdc4077c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:40.699075 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-6f415bdc-42bc-47a6-bfee-88f2fdc4077c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1448 microversion: 2.1 time: 0.148576 May 17 22:23:40.699884 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 616/1253] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:40 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1448 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:40.715302 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-15d6f6e8-e4c2-471c-83d8-5ff98f1b5b97 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:23:40.715914 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-15d6f6e8-e4c2-471c-83d8-5ff98f1b5b97 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:23:40.723163 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15d6f6e8-e4c2-471c-83d8-5ff98f1b5b97 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:40.723615 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15d6f6e8-e4c2-471c-83d8-5ff98f1b5b97 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:40.724378 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15d6f6e8-e4c2-471c-83d8-5ff98f1b5b97 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:40.724811 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-15d6f6e8-e4c2-471c-83d8-5ff98f1b5b97 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:40.851793 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-15d6f6e8-e4c2-471c-83d8-5ff98f1b5b97 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:23:40.859098 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-15d6f6e8-e4c2-471c-83d8-5ff98f1b5b97 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1448 microversion: 2.1 time: 0.147637 May 17 22:23:40.859703 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 638/1254] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:23:40 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1448 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:23:42.963276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-eb93c02f-fcd7-435b-ace0-62edcb6e2cb2 req-19d3b530-b4c4-4e93-9d82-cbe0bfa8ff66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "887a838d-b609-47bd-bf1c-780b3010e4cd", "tag": "a0660c66-a9fc-491e-ad45-b6d840554e29"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:23:42.963276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-eb93c02f-fcd7-435b-ace0-62edcb6e2cb2 req-19d3b530-b4c4-4e93-9d82-cbe0bfa8ff66 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:23:42.963276 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-eb93c02f-fcd7-435b-ace0-62edcb6e2cb2 req-19d3b530-b4c4-4e93-9d82-cbe0bfa8ff66 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:23:42.973128 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-eb93c02f-fcd7-435b-ace0-62edcb6e2cb2 req-19d3b530-b4c4-4e93-9d82-cbe0bfa8ff66 service nova] Creating event network-changed:a0660c66-a9fc-491e-ad45-b6d840554e29 for instance 887a838d-b609-47bd-bf1c-780b3010e4cd on hv-cinder-83998 May 17 22:23:42.978883 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-eb93c02f-fcd7-435b-ace0-62edcb6e2cb2 req-19d3b530-b4c4-4e93-9d82-cbe0bfa8ff66 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029333 May 17 22:23:42.979473 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 617/1255] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:24:01.759001 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:24:01.759761 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Tue May 17 22:24:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:24:08.742170 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:24:08.742765 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Tue May 17 22:24:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:25:26.859241 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-739453d3-e70a-4867-8617-90efa8f3ec6f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:26.859908 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-739453d3-e70a-4867-8617-90efa8f3ec6f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:25:26.866894 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-739453d3-e70a-4867-8617-90efa8f3ec6f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:26.867376 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-739453d3-e70a-4867-8617-90efa8f3ec6f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:26.868150 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-739453d3-e70a-4867-8617-90efa8f3ec6f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:26.868585 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-739453d3-e70a-4867-8617-90efa8f3ec6f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:26.896495 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-739453d3-e70a-4867-8617-90efa8f3ec6f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:25:26.960181 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-cd6d84f6-9a4f-41de-a9b6-4cafac7c1b2a req-7f94adda-19c5-49b4-bdfa-9edffce203a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "887a838d-b609-47bd-bf1c-780b3010e4cd", "tag": "a0660c66-a9fc-491e-ad45-b6d840554e29"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:25:26.965200 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-cd6d84f6-9a4f-41de-a9b6-4cafac7c1b2a req-7f94adda-19c5-49b4-bdfa-9edffce203a8 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:26.965635 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-cd6d84f6-9a4f-41de-a9b6-4cafac7c1b2a req-7f94adda-19c5-49b4-bdfa-9edffce203a8 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:26.978199 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-cd6d84f6-9a4f-41de-a9b6-4cafac7c1b2a req-7f94adda-19c5-49b4-bdfa-9edffce203a8 service nova] Creating event network-changed:a0660c66-a9fc-491e-ad45-b6d840554e29 for instance 887a838d-b609-47bd-bf1c-780b3010e4cd on hv-cinder-83998 May 17 22:25:26.983625 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-cd6d84f6-9a4f-41de-a9b6-4cafac7c1b2a req-7f94adda-19c5-49b4-bdfa-9edffce203a8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126762 May 17 22:25:26.984217 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 618/1256] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:25:27.235886 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-739453d3-e70a-4867-8617-90efa8f3ec6f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "DELETE /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 204 len: 0 microversion: 2.1 time: 0.381351 May 17 22:25:27.236762 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 639/1257] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:25:26 2022] DELETE /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:25:27.246721 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-380a3542-4fa7-4c01-b64f-06fa5f917f2f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:27.249205 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-380a3542-4fa7-4c01-b64f-06fa5f917f2f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:25:27.255412 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-380a3542-4fa7-4c01-b64f-06fa5f917f2f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:27.256498 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-380a3542-4fa7-4c01-b64f-06fa5f917f2f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:27.257575 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-380a3542-4fa7-4c01-b64f-06fa5f917f2f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:27.258935 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-380a3542-4fa7-4c01-b64f-06fa5f917f2f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:27.445701 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-380a3542-4fa7-4c01-b64f-06fa5f917f2f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:25:27.453036 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-380a3542-4fa7-4c01-b64f-06fa5f917f2f tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1572 microversion: 2.1 time: 0.210939 May 17 22:25:27.453598 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 619/1258] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:25:27 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1572 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:25:28.471900 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-a37fe757-efad-4d9d-afbd-1a6e8c663756 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:28.472592 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-a37fe757-efad-4d9d-afbd-1a6e8c663756 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:25:28.480043 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a37fe757-efad-4d9d-afbd-1a6e8c663756 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:28.480489 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a37fe757-efad-4d9d-afbd-1a6e8c663756 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:28.481252 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a37fe757-efad-4d9d-afbd-1a6e8c663756 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:28.481681 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-a37fe757-efad-4d9d-afbd-1a6e8c663756 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:28.665178 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-a37fe757-efad-4d9d-afbd-1a6e8c663756 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:25:28.672614 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-a37fe757-efad-4d9d-afbd-1a6e8c663756 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1572 microversion: 2.1 time: 0.204910 May 17 22:25:28.673183 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 640/1259] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:25:28 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1572 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:25:29.347660 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-75e4dc77-218c-4d3d-b80a-78dbebdd4228 req-6224fb44-4d6f-4826-b14b-1804149783f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "887a838d-b609-47bd-bf1c-780b3010e4cd", "name": "network-vif-deleted", "tag": "a0660c66-a9fc-491e-ad45-b6d840554e29"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:25:29.355558 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-75e4dc77-218c-4d3d-b80a-78dbebdd4228 req-6224fb44-4d6f-4826-b14b-1804149783f0 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:29.356000 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-75e4dc77-218c-4d3d-b80a-78dbebdd4228 req-6224fb44-4d6f-4826-b14b-1804149783f0 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:29.367077 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-75e4dc77-218c-4d3d-b80a-78dbebdd4228 req-6224fb44-4d6f-4826-b14b-1804149783f0 service nova] Creating event network-vif-deleted:a0660c66-a9fc-491e-ad45-b6d840554e29 for instance 887a838d-b609-47bd-bf1c-780b3010e4cd on hv-cinder-83998 May 17 22:25:29.372166 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-75e4dc77-218c-4d3d-b80a-78dbebdd4228 req-6224fb44-4d6f-4826-b14b-1804149783f0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081162 May 17 22:25:29.372734 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 620/1260] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:25:29.692621 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-4c75ca79-c1ba-4451-95b7-932fb83e42bd tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:29.693249 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-4c75ca79-c1ba-4451-95b7-932fb83e42bd tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:25:29.699965 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c75ca79-c1ba-4451-95b7-932fb83e42bd tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:29.700426 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c75ca79-c1ba-4451-95b7-932fb83e42bd tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:29.701203 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c75ca79-c1ba-4451-95b7-932fb83e42bd tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:29.701646 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-4c75ca79-c1ba-4451-95b7-932fb83e42bd tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:29.766998 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-4c75ca79-c1ba-4451-95b7-932fb83e42bd tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:25:29.774472 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-4c75ca79-c1ba-4451-95b7-932fb83e42bd tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 200 len: 1223 microversion: 2.1 time: 0.087387 May 17 22:25:29.775036 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 641/1261] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:25:29 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:25:30.793460 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f12e2252-b93d-49ed-9ea6-15da55faf75d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:30.794162 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-f12e2252-b93d-49ed-9ea6-15da55faf75d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: 887a838d-b609-47bd-bf1c-780b3010e4cd] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:25:30.800337 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f12e2252-b93d-49ed-9ea6-15da55faf75d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:30.800811 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f12e2252-b93d-49ed-9ea6-15da55faf75d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:30.802207 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f12e2252-b93d-49ed-9ea6-15da55faf75d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:30.802648 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-f12e2252-b93d-49ed-9ea6-15da55faf75d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:30.815633 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-f12e2252-b93d-49ed-9ea6-15da55faf75d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] HTTP exception thrown: Instance 887a838d-b609-47bd-bf1c-780b3010e4cd could not be found. May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f12e2252-b93d-49ed-9ea6-15da55faf75d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Request method failure captured: May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd HTTP/1.1 May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB8u4y3DmLq2izRJob6xINO_NaDgOS6QgIrdjjdlUizjlvorKAa_ooFrRQy_KtOuojiCWeGJxVfvteTNadpHpyZ0Q_9SyOc_n1VAXfgLOaKzquEjIRwWUFU3ZqbP79UV_Qhmxg9TVf5oyiF2dRKIhh_b7Hj4eoHS92WWLiclFWkVPoE May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 3cf34ac8db96460ba3b25bfe4aa0680c May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-TestVolumeBootPattern-1640545390 May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:25:30.817594 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:25:30.819398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3cf34ac8db96460ba3b25bfe4aa0680c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:25:30.819398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-TestVolumeBootPattern-1640545390 May 17 22:25:30.819398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 3cf34ac8db96460ba3b25bfe4aa0680c May 17 22:25:30.819398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1640545390 May 17 22:25:30.819398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-TestVolumeBootPattern-1640545390-project May 17 22:25:30.819398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:25:30.819398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:25:30.819398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 4c4de421a8224e89ab11a2a2d88f0315 May 17 22:25:30.819398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-TestVolumeBootPattern-1640545390-project May 17 22:25:30.819398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:25:30.819398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance 887a838d-b609-47bd-bf1c-780b3010e4cd could not be found. May 17 22:25:30.819398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': '887a838d-b609-47bd-bf1c-780b3010e4cd'} May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 887a838d-b609-47bd-bf1c-780b3010e4cd could not be found. May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:25:30.820467 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 887a838d-b609-47bd-bf1c-780b3010e4cd could not be found. May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 887a838d-b609-47bd-bf1c-780b3010e4cd could not be found. May 17 22:25:30.822098 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:30.823666 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-f12e2252-b93d-49ed-9ea6-15da55faf75d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Returning 404 to user: Instance 887a838d-b609-47bd-bf1c-780b3010e4cd could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:25:30.823666 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-f12e2252-b93d-49ed-9ea6-15da55faf75d tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd" status: 404 len: 111 microversion: 2.1 time: 0.030324 May 17 22:25:30.823666 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 621/1262] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:25:30 2022] GET /compute/v2.1/servers/887a838d-b609-47bd-bf1c-780b3010e4cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:25:34.141553 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-36ffe3ab-e51c-404a-b47e-ca7627f6e491 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:34.142213 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-36ffe3ab-e51c-404a-b47e-ca7627f6e491 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:25:34.144629 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-1c20de4e-708a-44d3-9316-8bfde9d076b5 req-d9aa48e0-a129-43d2-ab73-0061b5a1c89c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78f8466-4ba9-4f79-b263-35f1f2634d82", "tag": "ab43ce5c-af1b-4d01-ba97-a20314eed9f7"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:25:34.149079 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-36ffe3ab-e51c-404a-b47e-ca7627f6e491 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:34.149566 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-36ffe3ab-e51c-404a-b47e-ca7627f6e491 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:34.150341 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-36ffe3ab-e51c-404a-b47e-ca7627f6e491 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:34.150770 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-36ffe3ab-e51c-404a-b47e-ca7627f6e491 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:34.153048 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-1c20de4e-708a-44d3-9316-8bfde9d076b5 req-d9aa48e0-a129-43d2-ab73-0061b5a1c89c service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:34.153723 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-1c20de4e-708a-44d3-9316-8bfde9d076b5 req-d9aa48e0-a129-43d2-ab73-0061b5a1c89c service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:34.165613 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-1c20de4e-708a-44d3-9316-8bfde9d076b5 req-d9aa48e0-a129-43d2-ab73-0061b5a1c89c service nova] Creating event network-changed:ab43ce5c-af1b-4d01-ba97-a20314eed9f7 for instance c78f8466-4ba9-4f79-b263-35f1f2634d82 on hv-cinder-83998 May 17 22:25:34.170669 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-1c20de4e-708a-44d3-9316-8bfde9d076b5 req-d9aa48e0-a129-43d2-ab73-0061b5a1c89c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030003 May 17 22:25:34.171533 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 622/1263] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:25:34.178058 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-36ffe3ab-e51c-404a-b47e-ca7627f6e491 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Going to try to terminate instance {{(pid=117593) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 22:25:34.469372 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-36ffe3ab-e51c-404a-b47e-ca7627f6e491 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 204 len: 0 microversion: 2.1 time: 0.331413 May 17 22:25:34.469971 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 642/1264] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:25:34 2022] DELETE /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 22:25:34.479914 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-21f12c30-d44d-42e7-9a9c-3e11c8bf1d77 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:34.480184 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-21f12c30-d44d-42e7-9a9c-3e11c8bf1d77 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:25:34.486542 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-21f12c30-d44d-42e7-9a9c-3e11c8bf1d77 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:34.487263 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-21f12c30-d44d-42e7-9a9c-3e11c8bf1d77 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:34.488056 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-21f12c30-d44d-42e7-9a9c-3e11c8bf1d77 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:34.488501 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-21f12c30-d44d-42e7-9a9c-3e11c8bf1d77 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:34.658217 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.policy [None req-21f12c30-d44d-42e7-9a9c-3e11c8bf1d77 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117594) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:25:34.665608 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-21f12c30-d44d-42e7-9a9c-3e11c8bf1d77 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1575 microversion: 2.1 time: 0.190564 May 17 22:25:34.668952 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 623/1265] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:25:34 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 22:25:35.683371 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e91acd20-102c-43bd-9f02-ac7849840319 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:35.684061 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e91acd20-102c-43bd-9f02-ac7849840319 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:25:35.690422 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e91acd20-102c-43bd-9f02-ac7849840319 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:35.690874 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e91acd20-102c-43bd-9f02-ac7849840319 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:35.692523 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e91acd20-102c-43bd-9f02-ac7849840319 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:35.692960 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e91acd20-102c-43bd-9f02-ac7849840319 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:35.824826 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-e91acd20-102c-43bd-9f02-ac7849840319 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:25:35.832211 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e91acd20-102c-43bd-9f02-ac7849840319 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1575 microversion: 2.1 time: 0.153171 May 17 22:25:35.832866 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 643/1266] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:25:35 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:25:36.533019 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [req-71e01d8a-e985-4e33-9ad4-601e45cfac46 req-a692f365-bc38-43ed-9c59-a2c3ab1be909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78f8466-4ba9-4f79-b263-35f1f2634d82", "name": "network-vif-deleted", "tag": "ab43ce5c-af1b-4d01-ba97-a20314eed9f7"}]} {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 22:25:36.541650 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-71e01d8a-e985-4e33-9ad4-601e45cfac46 req-a692f365-bc38-43ed-9c59-a2c3ab1be909 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:36.542092 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [req-71e01d8a-e985-4e33-9ad4-601e45cfac46 req-a692f365-bc38-43ed-9c59-a2c3ab1be909 service nova] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:36.552749 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.compute.server_external_events [req-71e01d8a-e985-4e33-9ad4-601e45cfac46 req-a692f365-bc38-43ed-9c59-a2c3ab1be909 service nova] Creating event network-vif-deleted:ab43ce5c-af1b-4d01-ba97-a20314eed9f7 for instance c78f8466-4ba9-4f79-b263-35f1f2634d82 on hv-cinder-83998 May 17 22:25:36.557483 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [req-71e01d8a-e985-4e33-9ad4-601e45cfac46 req-a692f365-bc38-43ed-9c59-a2c3ab1be909 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028097 May 17 22:25:36.558049 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 624/1267] 10.222.0.24 () {64 vars in 1317 bytes} [Tue May 17 22:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 22:25:36.850002 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-55152cd8-588e-4dc8-b4f0-5efde2b0dbd8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:36.851370 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-55152cd8-588e-4dc8-b4f0-5efde2b0dbd8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:25:36.857929 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55152cd8-588e-4dc8-b4f0-5efde2b0dbd8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:36.858383 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55152cd8-588e-4dc8-b4f0-5efde2b0dbd8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:36.859198 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55152cd8-588e-4dc8-b4f0-5efde2b0dbd8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:36.859638 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-55152cd8-588e-4dc8-b4f0-5efde2b0dbd8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:36.928468 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.policy [None req-55152cd8-588e-4dc8-b4f0-5efde2b0dbd8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c4de421a8224e89ab11a2a2d88f0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf34ac8db96460ba3b25bfe4aa0680c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117593) authorize /opt/stack/nova/nova/policy.py:199}} May 17 22:25:36.936422 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-55152cd8-588e-4dc8-b4f0-5efde2b0dbd8 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 200 len: 1225 microversion: 2.1 time: 0.090836 May 17 22:25:36.937549 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 644/1268] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:25:36 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 22:25:37.954740 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-09c03cab-00f3-44ce-8ffd-d1540f28ed8c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:37.955461 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-09c03cab-00f3-44ce-8ffd-d1540f28ed8c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: c78f8466-4ba9-4f79-b263-35f1f2634d82] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:25:37.962139 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09c03cab-00f3-44ce-8ffd-d1540f28ed8c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:37.962588 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09c03cab-00f3-44ce-8ffd-d1540f28ed8c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:37.963384 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09c03cab-00f3-44ce-8ffd-d1540f28ed8c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:37.963819 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-09c03cab-00f3-44ce-8ffd-d1540f28ed8c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:37.977262 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-09c03cab-00f3-44ce-8ffd-d1540f28ed8c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] HTTP exception thrown: Instance c78f8466-4ba9-4f79-b263-35f1f2634d82 could not be found. May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-09c03cab-00f3-44ce-8ffd-d1540f28ed8c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Request method failure captured: May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 HTTP/1.1 May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB8u4y3DmLq2izRJob6xINO_NaDgOS6QgIrdjjdlUizjlvorKAa_ooFrRQy_KtOuojiCWeGJxVfvteTNadpHpyZ0Q_9SyOc_n1VAXfgLOaKzquEjIRwWUFU3ZqbP79UV_Qhmxg9TVf5oyiF2dRKIhh_b7Hj4eoHS92WWLiclFWkVPoE May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 3cf34ac8db96460ba3b25bfe4aa0680c May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-TestVolumeBootPattern-1640545390 May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:25:37.978847 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:25:37.980631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3cf34ac8db96460ba3b25bfe4aa0680c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:25:37.980631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-TestVolumeBootPattern-1640545390 May 17 22:25:37.980631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 3cf34ac8db96460ba3b25bfe4aa0680c May 17 22:25:37.980631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1640545390 May 17 22:25:37.980631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-TestVolumeBootPattern-1640545390-project May 17 22:25:37.980631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:25:37.980631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:25:37.980631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 4c4de421a8224e89ab11a2a2d88f0315 May 17 22:25:37.980631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-TestVolumeBootPattern-1640545390-project May 17 22:25:37.980631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:25:37.980631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance c78f8466-4ba9-4f79-b263-35f1f2634d82 could not be found. May 17 22:25:37.980631 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': 'c78f8466-4ba9-4f79-b263-35f1f2634d82'} May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78f8466-4ba9-4f79-b263-35f1f2634d82 could not be found. May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:25:37.981691 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78f8466-4ba9-4f79-b263-35f1f2634d82 could not be found. May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78f8466-4ba9-4f79-b263-35f1f2634d82 could not be found. May 17 22:25:37.983378 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:37.985063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-09c03cab-00f3-44ce-8ffd-d1540f28ed8c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Returning 404 to user: Instance c78f8466-4ba9-4f79-b263-35f1f2634d82 could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:25:37.985063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-09c03cab-00f3-44ce-8ffd-d1540f28ed8c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82" status: 404 len: 111 microversion: 2.1 time: 0.030169 May 17 22:25:37.985063 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 625/1269] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:25:37 2022] GET /compute/v2.1/servers/c78f8466-4ba9-4f79-b263-35f1f2634d82 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:25:38.455918 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e922aeae-0ad9-4702-83f0-3eea331fbaee tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:38.456797 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.compute.api [None req-e922aeae-0ad9-4702-83f0-3eea331fbaee tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117593) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:25:38.464246 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e922aeae-0ad9-4702-83f0-3eea331fbaee tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:38.464687 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e922aeae-0ad9-4702-83f0-3eea331fbaee tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:38.465503 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e922aeae-0ad9-4702-83f0-3eea331fbaee tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:38.465931 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG oslo_concurrency.lockutils [None req-e922aeae-0ad9-4702-83f0-3eea331fbaee tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:38.482064 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.wsgi [None req-e922aeae-0ad9-4702-83f0-3eea331fbaee tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] HTTP exception thrown: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e922aeae-0ad9-4702-83f0-3eea331fbaee tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Request method failure captured: May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: request: DELETE /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da HTTP/1.1 May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept: application/json May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Accept-Encoding: identity May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Connection: close May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Length: 0 May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Content-Type: application/json May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Host: 10.222.0.24 May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Openstack-System-Scope: None May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: User-Agent: python-urllib3/1.26.9 May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Auth-Token: gAAAAABihB8u4y3DmLq2izRJob6xINO_NaDgOS6QgIrdjjdlUizjlvorKAa_ooFrRQy_KtOuojiCWeGJxVfvteTNadpHpyZ0Q_9SyOc_n1VAXfgLOaKzquEjIRwWUFU3ZqbP79UV_Qhmxg9TVf5oyiF2dRKIhh_b7Hj4eoHS92WWLiclFWkVPoE May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Id: None May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Domain-Name: None May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Identity-Status: Confirmed May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Is-Admin-Project: True May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Id: default May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Domain-Name: Default May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Id: 3cf34ac8db96460ba3b25bfe4aa0680c May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Project-Name: tempest-TestVolumeBootPattern-1640545390 May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Role: reader,member May 17 22:25:38.483737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Roles: reader,member May 17 22:25:38.485488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3cf34ac8db96460ba3b25bfe4aa0680c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:25:38.485488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant: tempest-TestVolumeBootPattern-1640545390 May 17 22:25:38.485488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Id: 3cf34ac8db96460ba3b25bfe4aa0680c May 17 22:25:38.485488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1640545390 May 17 22:25:38.485488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User: tempest-TestVolumeBootPattern-1640545390-project May 17 22:25:38.485488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Id: default May 17 22:25:38.485488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Domain-Name: Default May 17 22:25:38.485488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Id: 4c4de421a8224e89ab11a2a2d88f0315 May 17 22:25:38.485488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: X-User-Name: tempest-TestVolumeBootPattern-1640545390-project May 17 22:25:38.485488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: method: > May 17 22:25:38.485488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: exception: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:25:38.485488 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: action_args: {'id': 'b13b97f7-9d11-48f9-8cab-88dde91e34da'} May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:25:38.486423 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:25:38.487979 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: ERROR nova.api.openstack.wsgi May 17 22:25:38.489595 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-e922aeae-0ad9-4702-83f0-3eea331fbaee tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Returning 404 to user: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. {{(pid=117593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:25:38.489595 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-e922aeae-0ad9-4702-83f0-3eea331fbaee tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 404 len: 111 microversion: 2.1 time: 0.034986 May 17 22:25:38.489595 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 645/1270] 10.222.0.24 () {58 vars in 1238 bytes} [Tue May 17 22:25:38 2022] DELETE /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:25:38.494126 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b226b89b-06d4-4012-bc9a-2ccdeef3015c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '>' {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:38.494740 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.compute.api [None req-b226b89b-06d4-4012-bc9a-2ccdeef3015c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] [instance: b13b97f7-9d11-48f9-8cab-88dde91e34da] Fetching instance by UUID {{(pid=117594) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 22:25:38.500658 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b226b89b-06d4-4012-bc9a-2ccdeef3015c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:38.501099 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b226b89b-06d4-4012-bc9a-2ccdeef3015c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:38.501855 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b226b89b-06d4-4012-bc9a-2ccdeef3015c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 22:25:38.502398 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG oslo_concurrency.lockutils [None req-b226b89b-06d4-4012-bc9a-2ccdeef3015c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Lock "8de9a745-abfa-4d62-8186-d36fd3c28976" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 22:25:38.516227 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.wsgi [None req-b226b89b-06d4-4012-bc9a-2ccdeef3015c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] HTTP exception thrown: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b226b89b-06d4-4012-bc9a-2ccdeef3015c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Request method failure captured: May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: request: GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da HTTP/1.1 May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept: application/json May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Accept-Encoding: identity May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Connection: close May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Length: 0 May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Content-Type: application/json May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Host: 10.222.0.24 May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Openstack-System-Scope: None May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: User-Agent: python-urllib3/1.26.9 May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Auth-Token: gAAAAABihB8u4y3DmLq2izRJob6xINO_NaDgOS6QgIrdjjdlUizjlvorKAa_ooFrRQy_KtOuojiCWeGJxVfvteTNadpHpyZ0Q_9SyOc_n1VAXfgLOaKzquEjIRwWUFU3ZqbP79UV_Qhmxg9TVf5oyiF2dRKIhh_b7Hj4eoHS92WWLiclFWkVPoE May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Id: None May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Domain-Name: None May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Identity-Status: Confirmed May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Is-Admin-Project: True May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Id: default May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Domain-Name: Default May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Id: 3cf34ac8db96460ba3b25bfe4aa0680c May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Project-Name: tempest-TestVolumeBootPattern-1640545390 May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Role: reader,member May 17 22:25:38.517720 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Roles: reader,member May 17 22:25:38.519392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_3cf34ac8db96460ba3b25bfe4aa0680c", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/3cf34ac8db96460ba3b25bfe4aa0680c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}] May 17 22:25:38.519392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant: tempest-TestVolumeBootPattern-1640545390 May 17 22:25:38.519392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Id: 3cf34ac8db96460ba3b25bfe4aa0680c May 17 22:25:38.519392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1640545390 May 17 22:25:38.519392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User: tempest-TestVolumeBootPattern-1640545390-project May 17 22:25:38.519392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Id: default May 17 22:25:38.519392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Domain-Name: Default May 17 22:25:38.519392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Id: 4c4de421a8224e89ab11a2a2d88f0315 May 17 22:25:38.519392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: X-User-Name: tempest-TestVolumeBootPattern-1640545390-project May 17 22:25:38.519392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: method: > May 17 22:25:38.519392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: exception: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:25:38.519392 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: action_args: {'id': 'b13b97f7-9d11-48f9-8cab-88dde91e34da'} May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: {{(pid=117594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 22:25:38.520333 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. May 17 22:25:38.522482 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: ERROR nova.api.openstack.wsgi May 17 22:25:38.523903 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: DEBUG nova.api.openstack.wsgi [None req-b226b89b-06d4-4012-bc9a-2ccdeef3015c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Returning 404 to user: Instance b13b97f7-9d11-48f9-8cab-88dde91e34da could not be found. {{(pid=117594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 22:25:38.523903 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO nova.api.openstack.requestlog [None req-b226b89b-06d4-4012-bc9a-2ccdeef3015c tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da" status: 404 len: 111 microversion: 2.1 time: 0.028905 May 17 22:25:38.523903 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: [pid: 117594|app: 0|req: 626/1271] 10.222.0.24 () {58 vars in 1235 bytes} [Tue May 17 22:25:38 2022] GET /compute/v2.1/servers/b13b97f7-9d11-48f9-8cab-88dde91e34da => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 22:25:39.949592 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: DEBUG nova.api.openstack.wsgi [None req-68df03d3-11cb-4381-9e6f-1d39bec0d4f6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] Calling method '.version_select at 0x7f09f2207c10>' {{(pid=117593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 22:25:40.025158 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO nova.api.openstack.requestlog [None req-68df03d3-11cb-4381-9e6f-1d39bec0d4f6 tempest-TestVolumeBootPattern-1640545390 tempest-TestVolumeBootPattern-1640545390-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1523709044" status: 202 len: 0 microversion: 2.1 time: 0.079376 May 17 22:25:40.025905 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: [pid: 117593|app: 0|req: 646/1272] 10.222.0.24 () {58 vars in 1262 bytes} [Tue May 17 22:25:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1523709044 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 22:25:48.717773 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:25:48.719339 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Tue May 17 22:25:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:26:03.066313 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:26:03.067165 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Tue May 17 22:26:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:27:21.766609 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:27:21.769882 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Tue May 17 22:27:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:27:54.701611 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:27:54.702129 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Tue May 17 22:27:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:29:08.726146 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:29:08.726640 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Tue May 17 22:29:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:29:23.075474 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:29:23.076068 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Tue May 17 22:29:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:30:41.775689 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:30:41.776359 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Tue May 17 22:30:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:30:48.754291 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:30:48.755512 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Tue May 17 22:30:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:30:57.311774 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:30:57.312413 dv-cinder-839987-6-iscsi devstack@n-api.service[117594]: Tue May 17 22:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 22:31:14.709737 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 22:31:14.710338 dv-cinder-839987-6-iscsi devstack@n-api.service[117593]: Tue May 17 22:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!